-- Logs begin at Thu 2022-07-14 13:45:24 UTC, end at Thu 2022-07-14 14:53:41 UTC. -- Jul 14 14:23:02.061463 dv-osbrick-849858-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 14:23:02.074874 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:23:02 2022] *** Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: nodename: dv-osbrick-849858-1-ceph Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: machine: x86_64 Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: clock source: unix Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: pcre jit disabled Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: detected number of CPU cores: 4 Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: current working directory: / Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: your processes number limit is 47680 Jul 14 14:23:02.079235 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: your memory page size is 4096 bytes Jul 14 14:23:02.080332 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: detected max file descriptor number: 2048 Jul 14 14:23:02.080332 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: lock engine: pthread robust mutexes Jul 14 14:23:02.080332 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: thunder lock: enabled Jul 14 14:23:02.080332 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 14:23:02.080332 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:23:02.131859 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: Python main interpreter initialized at 0x55d90f2529c0 Jul 14 14:23:02.131859 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: python threads support enabled Jul 14 14:23:02.131859 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: your server socket listen backlog is limited to 100 connections Jul 14 14:23:02.131859 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:23:02.132372 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:23:02.132372 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: *** Operational MODE: preforking *** Jul 14 14:23:02.132607 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:23:02.132607 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: spawned uWSGI master process (pid: 87176) Jul 14 14:23:02.132868 dv-osbrick-849858-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 14 14:23:02.136976 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: spawned uWSGI worker 1 (pid: 87185, cores: 1) Jul 14 14:23:02.136976 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: spawned uWSGI worker 2 (pid: 87186, cores: 1) Jul 14 14:23:02.136976 dv-osbrick-849858-1-ceph devstack@keystone.service[87176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:23:08.215173 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:08.215173 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: from cryptography.utils import int_from_bytes Jul 14 14:23:08.216425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:08.216425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: from cryptography.utils import int_from_bytes Jul 14 14:23:08.229007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:08.229007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: from cryptography.utils import int_from_bytes Jul 14 14:23:08.229959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:08.229959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: from cryptography.utils import int_from_bytes Jul 14 14:23:08.267743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:23:08.268019 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:23:08.268229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] command line args: [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:23:08.268513 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:23:08.268693 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ================================================================================ {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:23:08.268955 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] admin_token = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.269213 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] config_dir = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.269407 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.269592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] config_source = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.269779 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] debug = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.269988 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.270370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.270632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.270807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.271058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.271296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.271458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_config_append = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.271650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.271827 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_dir = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.271991 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_file = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.272236 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.272491 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.272763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.273024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.273373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.273373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.273911 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.273911 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.274448 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.274448 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.274448 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.275371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.275371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.275371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.276141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.276141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.276141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] publish_errors = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.277067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.277067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.277067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.277067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] standard_threads = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] use_journal = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.278831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] use_json = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.279579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] use_stderr = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.279579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] use_syslog = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.279579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.280113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.280303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:23:08.280503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.280695 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:23:08.280862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.281041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] command line args: [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:23:08.281272 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.281463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:23:08.281463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ================================================================================ {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:23:08.281801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.281978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] admin_token = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.282180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.282359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] config_dir = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.282549 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.282758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.282946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.283144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] config_source = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.283389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.283591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] debug = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.283591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.284041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.284219 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.284394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.284569 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.284755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.284926 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.285111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.285292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.285478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.285654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.285853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.286021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_config_append = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.286021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.286361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.286515 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_dir = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.286667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.286821 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_file = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.286993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.287179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.287345 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.287500 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.287672 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.287850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.288005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.288155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.288155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.288450 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.288602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.288748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.288900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.289054 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.289210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.289359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.289518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.289670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.289836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.290006 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.290273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.290425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.290578 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.290742 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.290884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.291080 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.291244 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.291411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.291562 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.291721 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.291721 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.291976 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.291976 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] publish_errors = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.292314 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.292487 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.292689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.292881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.293058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.293256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.293436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.293612 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.294157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.294346 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.294508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.294689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] standard_threads = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.294866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.295065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.295267 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.295433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.295433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.295748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.295917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] use_journal = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.296097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.296283 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] use_json = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.296709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.296860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] use_stderr = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.296860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] use_syslog = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.297150 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.297330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:08.297524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.297707 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.297883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.297883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.298183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.298361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.298553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.298727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.298911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.299140 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.299332 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.299514 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.299705 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.299976 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.300163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.300339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.300503 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.300670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.300862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301020 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301169 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301671 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.301860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.302182 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.302363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.302538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.302713 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.303027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.303203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.303384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.303583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.303773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.303950 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.304134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.304313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.304477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.304637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.304813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.304974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.305157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.305331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.305516 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.305792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.305981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.306160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.306351 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.306533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.306533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.306871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.307048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.307218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.307414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.307606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.307606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.307930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.308156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.309430 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.309679 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.309874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.310046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.310224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.310399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.310574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.310749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.310942 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.311171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.311363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.311540 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.311719 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.311919 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.312113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.312310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.312499 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.312685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.312880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.313066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.313258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.313436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.313620 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.313797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.313978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.314294 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.314482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.314647 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.314807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.314963 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.315168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.315330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.315511 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.315672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.315821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.315984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.316153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.316318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.316560 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.316719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.316877 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.317137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.317390 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.317568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.317730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.317902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.318886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.319344 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.319506 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.319676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.319837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.320009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.external = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.322602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.322804 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.322992 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.322992 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.323345 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.323528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.323686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.323860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.324865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.password = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.325059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.325236 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] auth.token = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.325505 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.325689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.325861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.326045 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.326234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.326412 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.326608 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.326801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.327063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.327241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.327420 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.327420 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.327780 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.327960 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.328131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.328322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.328509 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.328692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.328878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.328878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.329208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.329208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.329536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.329709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.329899 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.329899 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.330230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.330230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.330555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.330730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.330918 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.331118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.331290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.331461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.331632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.331815 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.331989 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.332164 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.332164 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.332489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.332693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.332894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.333077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.333251 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.333449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.333635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.333803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.333993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.334185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.334365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.334556 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.334726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.334900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.335120 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.335292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.335461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.335652 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.335812 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.335975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.336131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.336307 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.336487 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.336651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.336816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.336978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.337146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.337315 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.337501 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.337660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.337832 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.337994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.338144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.338311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.338495 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.338660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.338820 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.338965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.339137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.339270 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.339452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.339619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.external = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.339771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.339958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.340118 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.340295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.340487 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.340670 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.340855 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.341027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.password = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.341207 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.341384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] auth.token = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.341565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.341741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.341923 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.342107 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.342282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.342458 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.342652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.342840 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.343095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.343271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.343446 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.343614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.343802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.343974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.344153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.344322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.344498 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.344670 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.344670 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.345015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.345190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.345366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.345553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.345735 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.346006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.346189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.346385 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.346568 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.346741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.346918 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.347157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.347333 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.347526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.347711 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.347888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.348061 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.348257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.348440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.348603 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.348786 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.348968 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.349145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.349332 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.349600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.349760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.349931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.350102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.350273 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.350457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.350629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.350629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.350956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.351154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.351341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.351516 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.351516 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.351842 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.352023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.352203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.352403 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.352577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.352758 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.352937 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.353114 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.353286 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.353473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.353652 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.353843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.354022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.354199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.354379 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.354575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.354751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.354927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.355186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.355328 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.355473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.355640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.355784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.355925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.356062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.356209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.356470 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.356651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.356807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.356966 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.357135 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.357290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.357444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.357682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.357848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.358018 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.358179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.358349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.358507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.358676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.358835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.359055 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.359214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.359370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.359525 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.359698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.359855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360010 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360168 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.360956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.361112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.361267 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.361430 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.361599 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.361756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.361921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.362095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.362276 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.362461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.362637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.362796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.362962 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.363143 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.363300 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.363456 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.363629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.363793 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.363949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.364104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.364346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.364504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.364671 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.364827 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.364982 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.365147 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.365301 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.365463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.365649 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.365825 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.365995 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.366165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.366340 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.366510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.366693 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.366868 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.367077 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.367252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.367425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.367600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.367794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.367973 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.368149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.368336 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.368520 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.368696 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.368886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.369067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.369246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.369431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.369621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.369813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.369985 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.370149 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.370321 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.370499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.370684 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.371436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.371657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.371797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.371932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372340 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372472 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372857 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.372985 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] role.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373129 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] role.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373386 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.373904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374301 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374720 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374847 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.374969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375688 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.375949 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376074 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376345 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376595 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376728 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.376991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.377256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.377391 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.377520 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.377650 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.377777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378286 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378417 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378822 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.378955 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379247 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379358 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379358 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.379891 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380014 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.380901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381122 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.381230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] role.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] role.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.382956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.383790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.384391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.384507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.384629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.384745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.384861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.384978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385102 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385678 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.385917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.386030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.386140 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.386256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.386366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.386366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.387205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.387324 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.387447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.387629 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.387767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.387902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388283 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388411 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388557 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388687 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388806 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.388923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389047 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389172 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389578 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389702 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.389948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390099 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.connection = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390508 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.390883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391444 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391699 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391828 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.391973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392488 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392611 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.392876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393236 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.393873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.connection = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.394940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.395316 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.396292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.396292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.396292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.396292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.396292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:08.396292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:23:08.399189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.399428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.399667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.401193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.401426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.401657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.409820 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.411964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.441189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.441461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.444247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.444486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.500660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.500932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.558159 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.558589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.558722 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.558722 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.632174 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.632430 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.632430 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.632684 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.632817 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.632979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.633102 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.633228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.633352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.633479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.633618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.633740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.660971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.661210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.661432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.661647 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.661855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.662076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.662296 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.663012 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.663363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.663692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.664025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.664332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.664636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.664959 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.676172 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.679922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.690740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.691038 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.691214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.691442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.691673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.691892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.692078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.692227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87185) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.692384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.692526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.692746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.692965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.693182 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.693396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 14:23:08.711631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.711912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:23:08.712043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.712334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:23:08.712465 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.712465 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:23:08.712743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.712743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 14:23:08.712971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713223 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713364 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713491 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713757 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.713888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.725559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.725869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.726014 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.726154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.726293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.726431 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.726595 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.726732 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.735737 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.736224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.739407 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.739828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.739971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.739971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740329 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740595 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.740970 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.741112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.741318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.741451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.741577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.741711 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.741987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.742145 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.742266 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.742453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.742594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.742733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.771021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.771545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.772783 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.773069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.773374 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.773661 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.778683 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.778996 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.779296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.779563 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.779859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.780145 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.787014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.787361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.787661 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.787985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.792199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.792496 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.793760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.793913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.793913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.794211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.794348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.794348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.794585 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.794716 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.794852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.795037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.795175 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.795175 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.795423 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.795706 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.816019 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.816255 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.816387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.816532 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.821171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.821425 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.825041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.825362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.825618 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.825945 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.830406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.831065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.834130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.834805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.838199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.838509 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.838741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.838887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.839068 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.839205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.839341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.840609 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.840747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.840874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.841005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.841142 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.861236 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.861598 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.861744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.861874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.861999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.862233 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.862406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.862552 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.870446 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.871602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.872892 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.873168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.873344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.873625 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.876351 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.876638 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.876808 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.876946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.877078 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.877209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.877340 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.877487 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.877632 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.877860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.892235 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.892532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.892672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.892821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.892959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893101 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893520 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.893919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.894065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.894197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.913584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.913850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.917093 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.917346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.921551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.921780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.923252 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.923536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.924917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.925189 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.925346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.925487 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.925633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.925769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.933785 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.934120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.935695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.936136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.939084 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.939386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.939530 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.939662 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.939793 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.939936 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.940055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.940331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.950684 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.951014 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.951423 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.951801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.952111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.952396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.960033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87185) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.960331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.960615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.960769 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 14:23:08.960902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961055 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961187 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961489 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961767 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.961916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962390 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962522 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962649 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962776 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.962921 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963079 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963200 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963323 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87185) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.963849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.964032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:08.964296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 14:23:09.006345 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d90f2529c0 pid: 87185 (default app) Jul 14 14:23:09.007269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d90f2529c0 pid: 87186 (default app) Jul 14 14:23:09.009828 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22bc19-2995-4da9-8b02-1b2b48dc91ee None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:09.010119 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22bc19-2995-4da9-8b02-1b2b48dc91ee None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:09.010397 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22bc19-2995-4da9-8b02-1b2b48dc91ee None None] PATH_INFO: `/v3` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:09.016035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Thu Jul 14 14:23:09 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:18.129073 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:18.129616 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:18.129743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:18.134302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:18.140701 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:18.141219 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:18.141301 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:18.220657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: INFO dbcounter [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] Registered counter for database keystone Jul 14 14:23:18.244859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG oslo_db.sqlalchemy.engines [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:18.251886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writer thread running {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:18.446062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG passlib.handlers.bcrypt [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87185) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 14:23:18.446405 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG passlib.handlers.bcrypt [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87185) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 14:23:18.505880 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:18.507629 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:18.672924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 14:23:18.861834 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:18.951395 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: INFO dbcounter [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] Registered counter for database keystone Jul 14 14:23:18.974965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:18.982545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writer thread running {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:19.126077 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87bce-fe97-43a6-994f-97c3f3d97edc None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:19.131751 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:19.132541 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:19.132847 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:19.133344 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:19.145124 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:19.205062 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 14:23:19.205526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f547f4-b020-4b7c-b47c-b40fd6c04122 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:19.219241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Jul 14 14:23:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:23:19.226324 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:19.246090 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c711d-d9f1-43c2-8e81-45b60a3885cf None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:19.251966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:19.253121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:19.253493 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:19.253867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] PATH_INFO: `/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:19.255919 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] RBAC: Authorizing `identity:get_project(project_id=e1a3ee9626d64c6bbe126c49645c1edd)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:19.321334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING keystone.common.rbac_enforcer.enforcer [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 14:23:19.321689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cf10b-4b59-48e6-87f0-269229a2632c admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:19.327412 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Jul 14 14:23:19 2022] GET /identity/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd => generated 344 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:21.750264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c3ed-b4c8-453d-a8be-b6a3e6f84ec6 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:21.750833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c3ed-b4c8-453d-a8be-b6a3e6f84ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:21.750833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c3ed-b4c8-453d-a8be-b6a3e6f84ec6 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:21.755115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:21.762488 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:21.763061 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:21.763061 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:21.783767 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:21.785376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:21.793956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 14:23:21.818776 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4c3ed-b4c8-453d-a8be-b6a3e6f84ec6 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:21.832331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4c3ed-b4c8-453d-a8be-b6a3e6f84ec6 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:21.836759 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee8c8d-b5cc-43d1-bb07-0241355cb06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:21.837435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee8c8d-b5cc-43d1-bb07-0241355cb06d admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:21.838264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee8c8d-b5cc-43d1-bb07-0241355cb06d admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:21.838543 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee8c8d-b5cc-43d1-bb07-0241355cb06d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:21.847795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee8c8d-b5cc-43d1-bb07-0241355cb06d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:21.849637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee8c8d-b5cc-43d1-bb07-0241355cb06d admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:21.860674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Jul 14 14:23:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 14:23:21.867302 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:21.878432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18027-aa0d-490c-a2dc-3e0078d35b5a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:21.883382 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baacfff-5e54-4e6d-a127-94c0a0fa1b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:21.884268 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baacfff-5e54-4e6d-a127-94c0a0fa1b2f admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:21.885174 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baacfff-5e54-4e6d-a127-94c0a0fa1b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:21.885461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baacfff-5e54-4e6d-a127-94c0a0fa1b2f admin admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:21.887193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baacfff-5e54-4e6d-a127-94c0a0fa1b2f admin admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:21.889100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baacfff-5e54-4e6d-a127-94c0a0fa1b2f admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:21.890846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Jul 14 14:23:21 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:24.360922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f821a-7d6e-4e63-920a-35fc53024437 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:24.361446 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f821a-7d6e-4e63-920a-35fc53024437 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:24.361637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f821a-7d6e-4e63-920a-35fc53024437 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:24.363265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:24.370835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:24.371513 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:24.371860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:24.401742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:24.403811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:24.422714 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670dd63-6bc1-4f5b-a013-cd7138849b50 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:24.423093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670dd63-6bc1-4f5b-a013-cd7138849b50 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:24.423340 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670dd63-6bc1-4f5b-a013-cd7138849b50 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:24.424714 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:24.434033 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:24.434724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:24.435379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:24.483575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG passlib.handlers.bcrypt [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87186) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 14:23:24.483972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG passlib.handlers.bcrypt [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87186) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 14:23:24.519899 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:24.532085 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:24.533920 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:24.546616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:24.576943 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:24.672865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:24.691295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab072a-fea0-47f4-b04b-5823d8cda5d3 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:24.698696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:24.731443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:24.732254 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:24.732539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:24.732817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:24.869814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66248129-6188-4aaf-8f63-f5e693431de8 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:24.874210 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:24.877022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:24.893091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:24.894059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:24.894832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:24.899612 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:23:24.901243 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:24.939202 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:24.940769 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:24.941282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:24.941764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.005741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:25.028492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e203eb-a68f-40fa-a019-c0f108a1208b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:25.053406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.054959 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.075372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:25.076154 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:25.076507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:25.076931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.077942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:25.078358 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.079937 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.096624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:25.102536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:25.186672 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:23:25.193357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:25.197456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:25.248878 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d973e8-ca64-48a3-8559-ee52d14cb9ac None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:25.296562 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:25.297457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:25.297745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:25.298022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.299378 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.300903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.302672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:25 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:25.309266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:25.327258 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:25.345130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3f58-5804-4122-98df-9b1cb0c58c98 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:25.406995 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:25.408046 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:25.408194 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:25.408365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.443632 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f50d5-6300-4ca1-a894-0fcbd2673dd6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:25.444197 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.446233 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.485371 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:25.486297 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:23:25.486574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:25.488032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:25.489579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:23:25.489579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:23:25.489579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:25.489579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:25.489961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:25.489961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.490163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:23:25.491504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.494031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.496391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:25.496643 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:25.502581 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:25.585106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:25.614250 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:25.652920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e3fa-adb9-46da-8a97-f4f0d3dbb183 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:25.719191 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:25.720135 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:25.720596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:25.721052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.722561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.domain.id=default, user.id=186dc468057544fb86abd90933430e96) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:25.723081 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.725619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a09f8-8a56-4699-99ef-bd8e1ab533ff None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.739171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Jul 14 14:23:25 2022] GET /identity/v3/role_assignments?user.id=186dc468057544fb86abd90933430e96&scope.domain.id=default&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 233 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:25.809407 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bdc99-afa7-4b7d-815f-ac36815a0f2c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:25.857362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:25.858156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:25.858512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:25.858866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:25.859745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:25.860128 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:25.861687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833667f6-077d-4ae4-b838-771a59806107 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:25.885060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 10/21] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:29.896351 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f670f-a50c-407d-ac87-f8ab74dc9234 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:29.897116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f670f-a50c-407d-ac87-f8ab74dc9234 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:29.897116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f670f-a50c-407d-ac87-f8ab74dc9234 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:29.898703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 12/22] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:29.919586 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e572-f17a-4122-8d29-bde07768cd0e None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:29.920400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e572-f17a-4122-8d29-bde07768cd0e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:29.920400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e572-f17a-4122-8d29-bde07768cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:29.956289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-eaf6e572-f17a-4122-8d29-bde07768cd0e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:29.957556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-eaf6e572-f17a-4122-8d29-bde07768cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:29.991923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167124-2d53-4a01-9c6a-c0f22d4c4b5b None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:29.992349 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167124-2d53-4a01-9c6a-c0f22d4c4b5b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:29.992568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167124-2d53-4a01-9c6a-c0f22d4c4b5b None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:29.995153 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 13/23] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:30.001993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208abb-7a0b-43ce-99f4-19de1af3cd82 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.002569 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208abb-7a0b-43ce-99f4-19de1af3cd82 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.003197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208abb-7a0b-43ce-99f4-19de1af3cd82 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.004840 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 14/24] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:30.006994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.007667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.008236 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.057565 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:30.059441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:30.086107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 11/25] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:30.091366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.091715 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.092015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.132293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:30.134372 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:30.229480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:30.290465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 15/26] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:30.292495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:30.323335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 12/27] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:30.373773 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:30.480045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:30.506796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214668b-405a-4a1a-b482-a4e72bc7c199 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:30.541785 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72d9a-8e5d-4897-ad08-bbf969ea2e24 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:30.552765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:30.553892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.554365 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.554786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.568465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:30.571157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:30.584646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b767f-f299-439a-bb12-9c4935d5fd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:30.585480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b767f-f299-439a-bb12-9c4935d5fd19 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.585770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b767f-f299-439a-bb12-9c4935d5fd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.586054 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b767f-f299-439a-bb12-9c4935d5fd19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:23:30.596282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:30.597264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:30.598160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:23:30.598160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:23:30.598160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:23:30.598160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:30.600048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 16/28] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:30.600718 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b767f-f299-439a-bb12-9c4935d5fd19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:30.601443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-c57b767f-f299-439a-bb12-9c4935d5fd19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:30.611221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:30.612256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:30.613005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 13/29] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:30.613938 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339b4d7-9777-46df-92c2-c4deb19d6b10 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.614207 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339b4d7-9777-46df-92c2-c4deb19d6b10 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.614480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339b4d7-9777-46df-92c2-c4deb19d6b10 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.616815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 14/30] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:30.617129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339b4d7-9777-46df-92c2-c4deb19d6b10 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:30.659916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:30.746201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339b4d7-9777-46df-92c2-c4deb19d6b10 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:30.748377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9239d-cae6-4811-87e7-bb34367c0b63 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:30.782512 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:30.789379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:30.791167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.791167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.791400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.792304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:30.792423 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:30.794162 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:30.798096 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ca02c-1b05-4bf0-9128-92025eca6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:30.799366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca02c-1b05-4bf0-9128-92025eca6590 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.799858 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca02c-1b05-4bf0-9128-92025eca6590 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.800315 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca02c-1b05-4bf0-9128-92025eca6590 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:30.801312 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ca02c-1b05-4bf0-9128-92025eca6590 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:30.803018 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ca02c-1b05-4bf0-9128-92025eca6590 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:30.808800 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 15/31] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:30.809812 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:30.971145 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 17/32] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jul 14 14:23:30 2022] POST /identity/v3/roles => generated 225 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:30.973702 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:30.974253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:30.974911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.005475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:31.012196 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:31.014226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:31.023028 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4735d-e2b7-47b9-9278-eb78c788fa10 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:31.106454 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:31.107435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.107856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.108346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.109803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:31.110349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:31.112903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:31.160432 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 16/33] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:31.161445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:31.269373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 18/34] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:31.270700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:31.391857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c45f-81dd-427a-b72c-0cd5b3fddb55 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:31.445408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc00f1-f41b-49dc-8acd-3dbf4ecf3b81 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:31.458647 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:31.460409 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.460837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.461282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.466405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:31.466405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:31.478966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:31.511591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05171e58-8f18-4dcd-9fb0-cd1814726afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:31.512440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171e58-8f18-4dcd-9fb0-cd1814726afd None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.512733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171e58-8f18-4dcd-9fb0-cd1814726afd None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.513018 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171e58-8f18-4dcd-9fb0-cd1814726afd None admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.514356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05171e58-8f18-4dcd-9fb0-cd1814726afd None admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:31.516025 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05171e58-8f18-4dcd-9fb0-cd1814726afd None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:31.517767 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 19/35] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:31 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:31.519107 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb555d-06c3-4770-8c2f-5a56064daf55 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.519534 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb555d-06c3-4770-8c2f-5a56064daf55 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.519685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb555d-06c3-4770-8c2f-5a56064daf55 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.521035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 20/36] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:31.526068 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb555d-06c3-4770-8c2f-5a56064daf55 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:31.652829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 17/37] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:23:31 2022] POST /identity/v3/projects => generated 301 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:31.652829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:31.663514 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:31.695518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb555d-06c3-4770-8c2f-5a56064daf55 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:31.785591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592b56d-2e46-4512-a29f-15a2e4e12252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:31.786319 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592b56d-2e46-4512-a29f-15a2e4e12252 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.786678 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592b56d-2e46-4512-a29f-15a2e4e12252 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.787063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592b56d-2e46-4512-a29f-15a2e4e12252 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.788022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592b56d-2e46-4512-a29f-15a2e4e12252 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:31.789801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592b56d-2e46-4512-a29f-15a2e4e12252 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:31.812599 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 21/38] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jul 14 14:23:31 2022] POST /identity/v3/roles => generated 219 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:31.814190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.814623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.815013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.834704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47690-af4c-4103-a8b6-768199e5c421 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:31.854909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:31.856539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:31.946658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:31.949636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:31.950470 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:31.950774 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:31.951092 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:31.953367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:31.957160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:31.961533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 18/39] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:31.972487 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:31.989093 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 22/40] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:32.018198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:32.156047 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:32.179343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43f61-0b4a-44d6-962b-5b6a9ab653d5 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:32.193196 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69005c3-9b36-41d4-b234-5085d2a8f1f9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:32.246743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:32.247843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:32.248243 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:32.248641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] PATH_INFO: `/v3/domains/default/users/186dc468057544fb86abd90933430e96/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:32.249788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61235549-5eaa-428c-8e4d-06c2793d971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:32.250495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61235549-5eaa-428c-8e4d-06c2793d971e None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:32.250787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61235549-5eaa-428c-8e4d-06c2793d971e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:32.251098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61235549-5eaa-428c-8e4d-06c2793d971e None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:32.251808 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=186dc468057544fb86abd90933430e96, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:32.251968 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61235549-5eaa-428c-8e4d-06c2793d971e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:32.253588 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61235549-5eaa-428c-8e4d-06c2793d971e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:32.253761 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:32.271964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 23/41] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jul 14 14:23:32 2022] POST /identity/v3/roles => generated 223 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:32.273591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87dfb6-bf51-4b6f-8b9b-f842f577ac49 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:32.274566 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87dfb6-bf51-4b6f-8b9b-f842f577ac49 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:32.274926 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87dfb6-bf51-4b6f-8b9b-f842f577ac49 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:32.277148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 24/42] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:32.277400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 19/43] 10.222.0.65 () {58 vars in 1361 bytes} [Thu Jul 14 14:23:31 2022] PUT /identity/v3/domains/default/users/186dc468057544fb86abd90933430e96/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:23:32.286605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:32.286893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:32.287218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:32.309883 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:32.312006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:32.354279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:32.419900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 25/44] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:32.451415 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:32.626640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50161f-0dd9-4e93-a33d-67d2c5c9f62e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:32.672655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7f2e-0a75-4b66-8874-170d60cef644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:32.673466 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7f2e-0a75-4b66-8874-170d60cef644 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:32.673756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7f2e-0a75-4b66-8874-170d60cef644 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:32.674055 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7f2e-0a75-4b66-8874-170d60cef644 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:32.675502 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7f2e-0a75-4b66-8874-170d60cef644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:32.677021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7f2e-0a75-4b66-8874-170d60cef644 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:32.678768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 20/45] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:32.688325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:32.829932 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87232da-15fa-4035-b8fa-c84b5f41c601 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:32.877272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d61ca-2e47-4124-8e80-f0d248c48176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:32.877959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d61ca-2e47-4124-8e80-f0d248c48176 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:32.878254 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d61ca-2e47-4124-8e80-f0d248c48176 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:32.878535 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d61ca-2e47-4124-8e80-f0d248c48176 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:32.879319 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d61ca-2e47-4124-8e80-f0d248c48176 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:32.880876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d61ca-2e47-4124-8e80-f0d248c48176 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:32.922498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 26/46] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:23:32 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:23:34.866202 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff577-e2bc-4926-a4d0-9d25b51151c9 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:34.867253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff577-e2bc-4926-a4d0-9d25b51151c9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:34.867405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff577-e2bc-4926-a4d0-9d25b51151c9 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:34.869154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 21/47] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:34.875404 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:34.876161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:34.876161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:34.896411 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:34.897811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:34.912574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:35.007495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 27/48] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:35.033031 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff577-e2bc-4926-a4d0-9d25b51151c9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:35.044951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:35.224433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff577-e2bc-4926-a4d0-9d25b51151c9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:35.291142 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cdae-1002-4b99-a632-9ef1ca982763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:35.292604 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cdae-1002-4b99-a632-9ef1ca982763 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:35.293115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cdae-1002-4b99-a632-9ef1ca982763 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:35.293871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cdae-1002-4b99-a632-9ef1ca982763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:35.315285 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cdae-1002-4b99-a632-9ef1ca982763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-ffe5cdae-1002-4b99-a632-9ef1ca982763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:35.331269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:35.332386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:35.333311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:35.334232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 22/49] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:23:35.343014 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:35.474248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b4d97-9d79-47df-a5fc-81e97dabc3d7 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:35.474947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b4d97-9d79-47df-a5fc-81e97dabc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:35.475442 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b4d97-9d79-47df-a5fc-81e97dabc3d7 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:35.478393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 23/50] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:23:35.486865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:35.487191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:35.487484 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:35.512659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:35.514671 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:35.517019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910abf-08ae-40b0-9df5-81af63972146 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:35.562101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:35.562947 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:35.563431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:35.563813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:35.564771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:35.565170 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:35.566799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:35.578548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 28/51] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:35.587686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:35.600845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:35.603546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:35.617056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 24/52] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:35.642730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:35.723453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f749-9844-4117-9a88-d611a1a15654 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:35.766288 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:35.767204 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:35.767557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:35.767922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:35.769517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:35.770042 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943f188-f663-4f9f-b519-259812e61ab3 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:35.771528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:35.773563 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 29/53] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:35 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:35.779795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:35.821189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:35.822428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:35.822914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:35.823318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:35.825318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:35.827327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:35.829519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 25/54] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:35.836326 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:35.910761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:35.912905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:35.947344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478244ec-9fa7-4cac-803a-d5793f939546 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:35.972110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd15b25-3c5d-4854-b066-9e423957cd70 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:35.999227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:36.000580 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:36.001090 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:36.001590 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:36.004060 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:36.007401 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:36.011122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 30/55] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:36.027957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:36.028157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311678fb-a927-4012-a37a-113009351510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:36.028679 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311678fb-a927-4012-a37a-113009351510 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:36.028946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311678fb-a927-4012-a37a-113009351510 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:36.029221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311678fb-a927-4012-a37a-113009351510 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:36.029950 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311678fb-a927-4012-a37a-113009351510 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:36.031533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311678fb-a927-4012-a37a-113009351510 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:36.079468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 26/56] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Jul 14 14:23:35 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:23:36.198776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d341-510b-423e-88e6-e15897590029 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:36.242031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:36.243263 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:36.243263 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:36.243263 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:36.244144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.domain.id=default, user.id=186dc468057544fb86abd90933430e96) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:36.244457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:36.246012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17652c-b70d-4404-b9a0-f8a4cdf715b4 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:36.253067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 31/57] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Jul 14 14:23:36 2022] GET /identity/v3/role_assignments?user.id=186dc468057544fb86abd90933430e96&scope.domain.id=default&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 530 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:38.662221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44f9e-cfbe-4cc6-ad99-7f086496516b None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:38.662869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44f9e-cfbe-4cc6-ad99-7f086496516b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:38.662869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44f9e-cfbe-4cc6-ad99-7f086496516b None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:38.665143 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 27/58] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:38.671576 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:38.672127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:38.672127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:38.691106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:38.692461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:38.694739 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:38.771703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 32/59] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:38.821852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44f9e-cfbe-4cc6-ad99-7f086496516b None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:38.942705 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44f9e-cfbe-4cc6-ad99-7f086496516b None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:38.964184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:38.989042 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab3518-cd7e-4bd0-92cf-17f793c7cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:38.989937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3518-cd7e-4bd0-92cf-17f793c7cd28 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:38.990294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3518-cd7e-4bd0-92cf-17f793c7cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:38.990631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab3518-cd7e-4bd0-92cf-17f793c7cd28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:38.993109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3518-cd7e-4bd0-92cf-17f793c7cd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:38.994679 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab3518-cd7e-4bd0-92cf-17f793c7cd28 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:38.996593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 28/60] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:39.003471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:39.124772 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b1481-963f-4119-8da9-45e55a8e7084 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:39.165541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd084-34bb-4114-9027-241539666467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:39.166237 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd084-34bb-4114-9027-241539666467 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:39.166609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd084-34bb-4114-9027-241539666467 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:39.166934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd084-34bb-4114-9027-241539666467 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:39.167761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd084-34bb-4114-9027-241539666467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:39.169547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd084-34bb-4114-9027-241539666467 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:39.184148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:39.211660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 33/61] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:23:39 2022] POST /identity/v3/users => generated 275 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:43.457057 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2c016-87df-4cfd-8385-e3515114c250 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:43.458685 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2c016-87df-4cfd-8385-e3515114c250 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:43.459527 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2c016-87df-4cfd-8385-e3515114c250 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:43.463334 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 29/62] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:43.474835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9717e-d810-49a5-ad5c-9b119362c93c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:43.477477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9717e-d810-49a5-ad5c-9b119362c93c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:43.478203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9717e-d810-49a5-ad5c-9b119362c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:43.519592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-74a9717e-d810-49a5-ad5c-9b119362c93c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:43.522066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-74a9717e-d810-49a5-ad5c-9b119362c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:43.664779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 34/63] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:43.708165 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2c016-87df-4cfd-8385-e3515114c250 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:44.005490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2c016-87df-4cfd-8385-e3515114c250 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:44.108283 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:44.110235 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.111088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.111888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.143269 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126c3d-d13e-4242-a71e-314ef2b79f43 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.144227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126c3d-d13e-4242-a71e-314ef2b79f43 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.145000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126c3d-d13e-4242-a71e-314ef2b79f43 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.148704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 35/64] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:44.154039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:44.154920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0d586-a867-4af1-a6a2-90ef98b3cc63 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.155484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0d586-a867-4af1-a6a2-90ef98b3cc63 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.155979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0d586-a867-4af1-a6a2-90ef98b3cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:44.170567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:44.171567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:44.172346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:44.173448 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 30/65] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:23:44.182474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:44.197601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-84d0d586-a867-4af1-a6a2-90ef98b3cc63 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:44.198944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-84d0d586-a867-4af1-a6a2-90ef98b3cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:44.291611 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:44.397320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 36/66] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:44.399364 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d233a5-a236-4096-8adf-817f5b557b82 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.399889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d233a5-a236-4096-8adf-817f5b557b82 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.400328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d233a5-a236-4096-8adf-817f5b557b82 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.401958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 37/67] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:44.408319 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.408875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.409325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.431118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:44.432865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:44.447265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273a9b7-9358-4dbd-a550-a45a93f1ac4e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:44.505364 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:44.542917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:44.545177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 38/68] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:44.551248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.551248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.551248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.551248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:44.551248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:44.551913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:44.554470 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:44.580607 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 31/69] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:23:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:44.587525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:44.797846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cedde-d8a4-4b5d-8caa-0b66bb2054e9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:44.809438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44118743-1a94-47c2-92d9-62cde44375d7 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:44.820010 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:44.857816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99e91-0b1e-4647-8595-ec4bc27f33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:44.858837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99e91-0b1e-4647-8595-ec4bc27f33da None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.859196 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99e91-0b1e-4647-8595-ec4bc27f33da None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.859481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:44.859650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99e91-0b1e-4647-8595-ec4bc27f33da None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.860322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.860783 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.861090 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.875059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:44.883002 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e99e91-0b1e-4647-8595-ec4bc27f33da None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:44.884722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e99e91-0b1e-4647-8595-ec4bc27f33da None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:44.884881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:44.892049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 39/70] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:23:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:44.893551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:44.894961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 32/71] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:44 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:44.894961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e931d0-f458-4b63-9268-914fa65b72b0 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:44.894961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e931d0-f458-4b63-9268-914fa65b72b0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:44.894961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e931d0-f458-4b63-9268-914fa65b72b0 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:44.895489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 33/72] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:44.902031 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e931d0-f458-4b63-9268-914fa65b72b0 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:44.966194 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.056997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a16133-2d04-4dd8-9f14-0a43de57e2a6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.082274 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e931d0-f458-4b63-9268-914fa65b72b0 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.109783 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:45.110707 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.111136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.111498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.125463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:45.129567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704c865-9c09-4963-9b07-751d909f70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:45.130628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704c865-9c09-4963-9b07-751d909f70b9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.131141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704c865-9c09-4963-9b07-751d909f70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.131633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704c865-9c09-4963-9b07-751d909f70b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:45.133979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:45.135916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 40/73] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:45.137769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:45.173609 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.219760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704c865-9c09-4963-9b07-751d909f70b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:45.221250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704c865-9c09-4963-9b07-751d909f70b9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:45.296844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f49b2-4d85-4eee-845f-7731a6104ac0 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.301898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.349431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:45.351855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.352138 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.352426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.353454 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:45.353771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:45.355364 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a391cd-782b-49d0-b7b8-1b3fbdd26cbe None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:45.365629 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 41/74] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:23:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:45.367651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.367945 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.368236 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.388684 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:45.390227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:45.403478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 34/75] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:45.403478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff33b4c-dd21-41b5-a991-aac7d7070a92 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.403478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff33b4c-dd21-41b5-a991-aac7d7070a92 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.403478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff33b4c-dd21-41b5-a991-aac7d7070a92 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.403478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 35/76] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:45.404161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff33b4c-dd21-41b5-a991-aac7d7070a92 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:45.493518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 42/77] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:45.494420 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:45.512723 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.564592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff33b4c-dd21-41b5-a991-aac7d7070a92 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.607972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:45.608545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.608831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.609104 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.609865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:45.610171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:45.611621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:45.622348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 36/78] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:45.623007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:45.631442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.639594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43a2e-4b21-4753-8393-387cc091e779 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.688077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19553fb-70ee-4e30-85c1-bc5ea4f40f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:45.689583 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19553fb-70ee-4e30-85c1-bc5ea4f40f62 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.690068 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19553fb-70ee-4e30-85c1-bc5ea4f40f62 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.690552 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19553fb-70ee-4e30-85c1-bc5ea4f40f62 None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.692831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19553fb-70ee-4e30-85c1-bc5ea4f40f62 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:45.696167 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19553fb-70ee-4e30-85c1-bc5ea4f40f62 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:45.699421 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 43/79] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:45 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:45.701624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.702122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.702606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.729028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:45.731168 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:45.753565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21af2b-0009-4a47-adb8-2c755145b1d9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.785948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.797709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:45.798842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:45.799300 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:45.799992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:45.801622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:45.804278 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:45.806488 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 37/80] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:45 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:45.807975 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:45.825894 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 44/81] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:45.826819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:45.968541 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa87dd-f7b4-448f-b274-1f9bb5029155 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:45.970870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:45.980826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dd8b1-b52a-4d1f-8351-d6c935808b88 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.017635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.018921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.019422 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.019900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.030695 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.032009 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.032532 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.033159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.034646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:46.034900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:46.036591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:46.039122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 45/82] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:45 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:46.039962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:46.044956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:46.045860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 38/83] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:46.046648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:46.146689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:46.182588 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fecf-c96b-4ed0-983a-276c1b5bba08 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.225021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f07e-2176-4796-a189-1e71335fa387 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.227967 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711832-842e-4977-bc05-37a976193078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.228958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711832-842e-4977-bc05-37a976193078 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.229425 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711832-842e-4977-bc05-37a976193078 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.229819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711832-842e-4977-bc05-37a976193078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.274203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:46.278146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.278870 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.279189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.279469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.280336 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=0a9f7fb5dd904c9d89b8d844683f4118) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:46.280654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:46.282198 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:46.292443 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 39/84] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:46 2022] GET /identity/v3/role_assignments?user.id=0a9f7fb5dd904c9d89b8d844683f4118&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:46.293594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:46.341195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f711832-842e-4977-bc05-37a976193078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:46.343535 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f711832-842e-4977-bc05-37a976193078 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:46.439283 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514be44-339b-4d7f-a48a-65fba4c6c9f8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.473215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:46.498237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.499022 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.499309 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.499583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.501185 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:46.502841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:46.504655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 40/85] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:46.504655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:46.527205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 46/86] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:46.528450 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711832-842e-4977-bc05-37a976193078 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:46.636408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:46.664125 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b5520-7095-4e53-979a-081c568dc49e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.700431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711832-842e-4977-bc05-37a976193078 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.711700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.712543 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.712958 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.713426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.749356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:46.750470 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:46.751093 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:46.751450 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:46.752276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:46.752586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:46.754103 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:46.776001 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 47/87] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:23:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:46.776001 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:46.794329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:46.815848 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:46.818397 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:46.953435 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e04e1-e277-434b-8dc4-a69a5a5d2d38 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:46.993306 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 41/88] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:46.994749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:47.004899 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:47.019127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:47.019996 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:47.020414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:47.020822 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:47.021703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:47.023745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:47.050544 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 48/89] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:23:46 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:47.051775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:47.180672 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:47.218365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017de41-003b-40d6-a149-f2199bda693d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:47.252997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772f6bc-cb07-4e4f-b843-22e349fb041d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:47.308439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:47.310861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:47.312382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:47.313580 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:47.316580 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:47.320561 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:47.320848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:47.322414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:47.323081 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:47.323669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:47.325248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 42/90] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:46 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:47.326363 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:47.327327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:47.329355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:47.339012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 49/91] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:47 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:47.339012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:47.455096 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:47.587352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cda1e-7d4e-42a2-a939-4046628184ac None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:47.589179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d128ea4-70e3-4693-808e-50ce919099b9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:47.660161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:47.661609 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:47.662098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:47.662602 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:47.668389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:47.670531 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:47.672327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:47.672327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:47.672327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:47.674724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] RBAC: Adding query filter params (role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=0a9f7fb5dd904c9d89b8d844683f4118) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:47.674724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:47.676638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:47.680900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:47.684620 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 43/92] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:47 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:47.686480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:47.688408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 50/93] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:47 2022] GET /identity/v3/role_assignments?user.id=0a9f7fb5dd904c9d89b8d844683f4118&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:47.700523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:47.763015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:48.032126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea5f4d-5e31-4669-b88d-6eb209a5b902 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:48.033154 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddf39a-144a-4cad-9dee-9b2975cd864b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:48.075049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:48.122814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:48.123827 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:48.124508 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:48.124795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:48.125072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:48.125934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=186dc468057544fb86abd90933430e96) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:48.126248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:48.127798 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:48.130483 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:48.130758 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:48.131062 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:48.147805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 51/94] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:47 2022] GET /identity/v3/role_assignments?user.id=186dc468057544fb86abd90933430e96&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 259 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:48.223703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:48.226651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:48.266156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:48.406587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 44/95] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:48.416678 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:48.610881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396a42e-9c19-4d1f-a0ab-872985cdd24e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:48.665072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5642933-083d-443a-9cb3-b59bd1144b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:48.666455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642933-083d-443a-9cb3-b59bd1144b68 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:48.667042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642933-083d-443a-9cb3-b59bd1144b68 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:48.668203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642933-083d-443a-9cb3-b59bd1144b68 None admin] PATH_INFO: `/v3/projects/06b12608f9204a21bdad2f7a736dc73d` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:48.676238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642933-083d-443a-9cb3-b59bd1144b68 None admin] RBAC: Authorizing `identity:get_project(project_id=06b12608f9204a21bdad2f7a736dc73d)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:48.679866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642933-083d-443a-9cb3-b59bd1144b68 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:48.682010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 52/96] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:48 2022] GET /identity/v3/projects/06b12608f9204a21bdad2f7a736dc73d => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:48.691524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:48.878769 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0716-5413-4778-b3de-1b447f745ed5 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:48.922490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:48.937646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:48.938339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:48.938630 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:48.938915 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:48.939826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=06b12608f9204a21bdad2f7a736dc73d, user.id=0a9f7fb5dd904c9d89b8d844683f4118) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:48.940154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:48.941642 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af74f5-823f-4ba3-80ff-616d40aed1fd None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:48.952084 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 45/97] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:48 2022] GET /identity/v3/role_assignments?user.id=0a9f7fb5dd904c9d89b8d844683f4118&scope.project.id=06b12608f9204a21bdad2f7a736dc73d&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:50.572797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb170-9195-4dbd-b3b0-a2049473dd66 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:50.573925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb170-9195-4dbd-b3b0-a2049473dd66 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:50.574422 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb170-9195-4dbd-b3b0-a2049473dd66 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:50.576858 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 53/98] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:50.582730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:50.583727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:50.584874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:50.614416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:50.616633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:50.715380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 46/99] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:50.756830 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb170-9195-4dbd-b3b0-a2049473dd66 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:50.874780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:50.994021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb170-9195-4dbd-b3b0-a2049473dd66 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:51.068045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142d740-8528-4c0e-932f-0de7b00fb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:51.069728 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d740-8528-4c0e-932f-0de7b00fb957 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:51.070350 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d740-8528-4c0e-932f-0de7b00fb957 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:51.070841 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d740-8528-4c0e-932f-0de7b00fb957 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:51.100654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142d740-8528-4c0e-932f-0de7b00fb957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-9142d740-8528-4c0e-932f-0de7b00fb957 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:51.109762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:51.110677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:51.116799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:51.123158 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 54/100] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:51.136164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:51.382612 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8495-bfa6-44c4-9e57-02dd7a901101 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:51.454435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:51.542517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8979ba-8af4-4282-a9bd-59d07c27af55 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:51.542517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8979ba-8af4-4282-a9bd-59d07c27af55 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:51.542517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8979ba-8af4-4282-a9bd-59d07c27af55 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:51.546638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 55/101] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:51.554066 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:51.556152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:51.556152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:51.557366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:51.558129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:51.558688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:51.566558 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:51.566558 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:51.566558 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:51.569848 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:51.607128 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 47/102] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:23:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:51.613940 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:51.626347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:51.628540 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:51.844785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 56/103] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 14:23:51.920917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:51.953376 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48e727-c2bb-465a-8b20-930753d5d3ac None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:52.033426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d4da-4bb3-4ea9-8188-774949407e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:52.035428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d4da-4bb3-4ea9-8188-774949407e2e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.036325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d4da-4bb3-4ea9-8188-774949407e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.037167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d4da-4bb3-4ea9-8188-774949407e2e None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.040243 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d4da-4bb3-4ea9-8188-774949407e2e None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:52.043841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d4da-4bb3-4ea9-8188-774949407e2e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:52.048054 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:52.048507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 48/104] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:51 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:52.051044 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f841-9eb8-4549-8884-5f0b4301f0a3 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.051554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f841-9eb8-4549-8884-5f0b4301f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.052065 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f841-9eb8-4549-8884-5f0b4301f0a3 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.056071 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 49/105] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:52.057709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138f841-9eb8-4549-8884-5f0b4301f0a3 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:52.149141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9b53-7d63-471f-896d-ffde71392063 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:52.199851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:52.202455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e357a4d-b3fa-4d27-bbd4-87172a2f43cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:52.203904 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e357a4d-b3fa-4d27-bbd4-87172a2f43cd None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.204514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e357a4d-b3fa-4d27-bbd4-87172a2f43cd None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.205253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e357a4d-b3fa-4d27-bbd4-87172a2f43cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.228076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e357a4d-b3fa-4d27-bbd4-87172a2f43cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:52.248039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138f841-9eb8-4549-8884-5f0b4301f0a3 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6e357a4d-b3fa-4d27-bbd4-87172a2f43cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:52.248957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:52.249797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:23:52.250541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:52.252130 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 57/106] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:52.253716 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.254004 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.254284 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.278725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:52.280136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:52.327466 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bdedc-81e6-4c67-ad73-e79c7f965554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:52.329580 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bdedc-81e6-4c67-ad73-e79c7f965554 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.330427 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bdedc-81e6-4c67-ad73-e79c7f965554 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.331297 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bdedc-81e6-4c67-ad73-e79c7f965554 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.335691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bdedc-81e6-4c67-ad73-e79c7f965554 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:52.338876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bdedc-81e6-4c67-ad73-e79c7f965554 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:52.341987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 50/107] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:52 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:52.345412 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3038-447b-4d8f-8610-88ad00c7385a None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.346789 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3038-447b-4d8f-8610-88ad00c7385a None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.347802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3038-447b-4d8f-8610-88ad00c7385a None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.351332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 51/108] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:52.353659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf3038-447b-4d8f-8610-88ad00c7385a None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:52.368016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 58/109] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:52.369087 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:52.406010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:52.540913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b73ed2-eed9-4950-881e-07c8a4aa9e33 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:52.621524 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bccec2-266f-4f11-b60d-d4031639e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:52.623319 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bccec2-266f-4f11-b60d-d4031639e71a None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.623930 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bccec2-266f-4f11-b60d-d4031639e71a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.624437 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bccec2-266f-4f11-b60d-d4031639e71a None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261/users/0a9f7fb5dd904c9d89b8d844683f4118/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.629056 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bccec2-266f-4f11-b60d-d4031639e71a None admin] RBAC: Authorizing `identity:create_grant(project_id=415102e6bd7442b3b94057725e5ab261, user_id=0a9f7fb5dd904c9d89b8d844683f4118, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:52.640036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bccec2-266f-4f11-b60d-d4031639e71a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:52.650276 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf3038-447b-4d8f-8610-88ad00c7385a None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:52.661320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 59/110] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:23:52 2022] PUT /identity/v3/projects/415102e6bd7442b3b94057725e5ab261/users/0a9f7fb5dd904c9d89b8d844683f4118/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:23:52.666210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.666668 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.667443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.673032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:52.701497 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:52.702405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.702792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.703240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.704205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:52.704618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:52.706316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:52.706999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:52.711013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:52.721796 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 52/111] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:23:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:52.723399 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:52.863529 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334b6b-b8a7-4e67-9a1d-d0a787ac4e2c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:52.878811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 60/112] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:52.880955 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:52.909141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5f03f-bb66-4747-953c-4769e470f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:52.910205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5f03f-bb66-4747-953c-4769e470f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.910553 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5f03f-bb66-4747-953c-4769e470f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.910906 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5f03f-bb66-4747-953c-4769e470f7a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.913013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5f03f-bb66-4747-953c-4769e470f7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:52.914765 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5f03f-bb66-4747-953c-4769e470f7a5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:52.916453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:52.918028 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 53/113] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:52.924301 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ec6b-5dd0-4fd8-be05-0e964857a661 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:52.924865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ec6b-5dd0-4fd8-be05-0e964857a661 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:52.925359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ec6b-5dd0-4fd8-be05-0e964857a661 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:52.928458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 54/114] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:52.929540 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ec6b-5dd0-4fd8-be05-0e964857a661 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:52.993702 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:53.076740 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ec6b-5dd0-4fd8-be05-0e964857a661 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:53.116971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51b688-aa1a-4240-a157-2ee280d082f6 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:53.130474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:53.131693 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.132058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.132342 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.149518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:53.160724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:53.162095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:53.163710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 55/115] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:23:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:53.164421 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:53.189355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f89c6-df38-4f93-abaa-4847e610766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:53.190407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f89c6-df38-4f93-abaa-4847e610766a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.191021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f89c6-df38-4f93-abaa-4847e610766a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.191312 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f89c6-df38-4f93-abaa-4847e610766a None admin] PATH_INFO: `/v3/users/54700039318d4014811e2e0bde5725b6` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.210313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f89c6-df38-4f93-abaa-4847e610766a None admin] RBAC: Authorizing `identity:get_user(user_id=54700039318d4014811e2e0bde5725b6)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:53.211892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f89c6-df38-4f93-abaa-4847e610766a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:53.214381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 61/116] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:52 2022] GET /identity/v3/users/54700039318d4014811e2e0bde5725b6 => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:53.216108 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.216395 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.216816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.239080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:53.240563 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:53.339921 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 62/117] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:53.341052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:53.345163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:53.372211 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cccea7-e014-429f-8181-72dba6322be2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:53.375983 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:53.420239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:53.420962 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.421260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.421548 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.422311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:53.423883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:53.456356 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 56/118] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:23:53 2022] POST /identity/v3/projects => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:53.457257 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:53.581440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98c46c-2a35-464c-8c3f-0ba1136f7d8a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:53.637443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:53.641120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.642100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.643309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.646201 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:53.647956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:53.652186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31acd8-bea8-468e-ae9e-f1753990024e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:53.652488 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563938-b241-4910-baaa-2b4161d8300c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:53.674994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 63/119] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:23:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:53.678256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ecfa5-f2bc-4146-b256-b17cd1b647bc None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.679025 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ecfa5-f2bc-4146-b256-b17cd1b647bc None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.679690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ecfa5-f2bc-4146-b256-b17cd1b647bc None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.683354 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 64/120] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:53.684249 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ecfa5-f2bc-4146-b256-b17cd1b647bc None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:53.712361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5885f5-db55-4091-bd4b-815ea8132c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:53.713056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5885f5-db55-4091-bd4b-815ea8132c92 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.713513 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5885f5-db55-4091-bd4b-815ea8132c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.714038 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5885f5-db55-4091-bd4b-815ea8132c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:53.767068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:53.822658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:53.867558 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5885f5-db55-4091-bd4b-815ea8132c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:53.869239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5885f5-db55-4091-bd4b-815ea8132c92 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:53.913820 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ecfa5-f2bc-4146-b256-b17cd1b647bc None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:53.983038 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:53.984338 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:53.984338 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:53.984602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.001598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:54.010856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:54.012449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 65/121] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:54.013897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.073168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 57/122] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:54.074709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87244f3a-093f-4257-b537-f630753d3976 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.075174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87244f3a-093f-4257-b537-f630753d3976 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.075320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87244f3a-093f-4257-b537-f630753d3976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.102638 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-87244f3a-093f-4257-b537-f630753d3976 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:54.104125 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-87244f3a-093f-4257-b537-f630753d3976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:54.192740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a021a-a44c-45f4-8e70-b2cc10681342 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:54.209927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:54.233744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:54.252787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:54.253724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.254113 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.254383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.256714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:54.258291 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:54.258738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 58/123] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:23:54.260357 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 66/124] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:54.260897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87244f3a-093f-4257-b537-f630753d3976 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.262006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.442170 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a5e80-2f05-404f-aa8e-ab94fb18abac None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:54.495476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:54.496381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.496811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.496955 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.498532 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:54.500424 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:54.501703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87244f3a-093f-4257-b537-f630753d3976 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:54.503016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 67/125] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:54.503884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.574460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:54.576177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.577068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.577966 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.579772 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:54.580632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:54.584775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:54.591216 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:54.607724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 59/126] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:54.609779 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.654956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9784-12ed-48fa-ad9d-e30497888398 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:54.703276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:54.704233 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.704518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.704799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.706469 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:54.708733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:54.711944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 68/127] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:54.712981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.714144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:54.826490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89aa04-477e-4979-bcd2-6447e4e5898e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:54.861696 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8262921-69f8-4fbc-bff7-46c8b3636c70 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:54.898471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:54.900383 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.901196 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.901959 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.918594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:54.927454 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:54.932982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:54.934016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:54.934497 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:54.934997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:54.936557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] RBAC: Adding query filter params (role.id=9d5a697b555842e6ad223ef3d40cb9e0, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=54700039318d4014811e2e0bde5725b6) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:54.937094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:54.939729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:54.946244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:54.947931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:54.949437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:23:54.951791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 69/128] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/role_assignments?user.id=54700039318d4014811e2e0bde5725b6&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=9d5a697b555842e6ad223ef3d40cb9e0 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:54.952648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:54.954751 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 60/129] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:54.956675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:55.163196 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caf29b-5b2f-4c18-befd-00fbe1ac730c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:55.173592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e7f2-ca42-4d5b-971f-02917110fdc8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:55.184041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:55.237301 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711990-6e68-4104-8a96-888457a6987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:55.239534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711990-6e68-4104-8a96-888457a6987e None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:55.240379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711990-6e68-4104-8a96-888457a6987e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:55.241145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711990-6e68-4104-8a96-888457a6987e None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261/users/0a9f7fb5dd904c9d89b8d844683f4118/roles/7ec579bc6ca745cea09c4d5f57d4663d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:55.245462 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de711990-6e68-4104-8a96-888457a6987e None admin] RBAC: Authorizing `identity:create_grant(project_id=415102e6bd7442b3b94057725e5ab261, user_id=0a9f7fb5dd904c9d89b8d844683f4118, role_id=7ec579bc6ca745cea09c4d5f57d4663d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:55.248610 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de711990-6e68-4104-8a96-888457a6987e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:55.276445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 61/130] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:23:54 2022] PUT /identity/v3/projects/415102e6bd7442b3b94057725e5ab261/users/0a9f7fb5dd904c9d89b8d844683f4118/roles/7ec579bc6ca745cea09c4d5f57d4663d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:23:55.278466 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711990-6e68-4104-8a96-888457a6987e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:55.284771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:55.289217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:55.289781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:55.290388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:55.293875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:55.296572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:55.300340 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 70/131] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:54 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:55.307291 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:55.574076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:55.677742 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711990-6e68-4104-8a96-888457a6987e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:55.721972 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310c9f-f356-43b0-8504-e19c8a346656 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:55.804825 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:55.806769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:55.807895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:55.808641 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:55.811383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:55.814087 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:55.818625 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 71/132] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:55 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:55.825380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:55.831859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:55.832681 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:55.833022 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:55.833204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:55.835495 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:55.835495 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:55.837748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:55.848851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 62/133] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 571 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:55.854774 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:55.900658 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:56.012476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a2baf-ea63-404e-84be-ffea9c4e409a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:56.048366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:56.061110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:56.062174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ffeb0-1340-4810-9896-6f5a58f12973 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:56.062621 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.063166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.063649 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261/users/186dc468057544fb86abd90933430e96/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.066079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=415102e6bd7442b3b94057725e5ab261, user_id=186dc468057544fb86abd90933430e96, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:56.067872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:56.092775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 72/134] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:23:55 2022] PUT /identity/v3/projects/415102e6bd7442b3b94057725e5ab261/users/186dc468057544fb86abd90933430e96/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:23:56.130153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:56.132236 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.132777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.133261 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.136978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:56.139059 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:56.141353 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 63/135] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:55 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:56.148783 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:56.286665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d865-f48f-4495-b99e-0666bc3c75b6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:56.339586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e30ae-f7f4-448e-82d4-7673be022fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:56.341041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e30ae-f7f4-448e-82d4-7673be022fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.341712 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e30ae-f7f4-448e-82d4-7673be022fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.342223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e30ae-f7f4-448e-82d4-7673be022fb3 None admin] PATH_INFO: `/v3/projects/06b12608f9204a21bdad2f7a736dc73d` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.344053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e30ae-f7f4-448e-82d4-7673be022fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=06b12608f9204a21bdad2f7a736dc73d)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:56.346016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e30ae-f7f4-448e-82d4-7673be022fb3 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:56.348441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 73/136] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:56 2022] GET /identity/v3/projects/06b12608f9204a21bdad2f7a736dc73d => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:56.355462 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:56.539326 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:56.544720 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c2d01-7727-4a04-b92f-e771eea5f203 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:56.601345 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec3918-84c4-4d48-b9cf-e5c190171723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:56.602186 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3918-84c4-4d48-b9cf-e5c190171723 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.602477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3918-84c4-4d48-b9cf-e5c190171723 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.602766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3918-84c4-4d48-b9cf-e5c190171723 None admin] PATH_INFO: `/v3/projects/06b12608f9204a21bdad2f7a736dc73d/users/0a9f7fb5dd904c9d89b8d844683f4118/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.605128 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec3918-84c4-4d48-b9cf-e5c190171723 None admin] RBAC: Authorizing `identity:create_grant(project_id=06b12608f9204a21bdad2f7a736dc73d, user_id=0a9f7fb5dd904c9d89b8d844683f4118, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:56.606630 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec3918-84c4-4d48-b9cf-e5c190171723 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:56.629139 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 64/137] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:23:56 2022] PUT /identity/v3/projects/06b12608f9204a21bdad2f7a736dc73d/users/0a9f7fb5dd904c9d89b8d844683f4118/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:23:56.641561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0b90a-7986-4f59-ad46-e8d834817f3c None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.641876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0b90a-7986-4f59-ad46-e8d834817f3c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.642153 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0b90a-7986-4f59-ad46-e8d834817f3c None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.644186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 74/138] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:56.649626 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75521-460d-4b1b-aed0-b6c694634cd0 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.649934 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75521-460d-4b1b-aed0-b6c694634cd0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.650230 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75521-460d-4b1b-aed0-b6c694634cd0 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.652043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 65/139] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:56.663596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.663596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.663596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.665270 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:56.665890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:56.666376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:56.682042 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:56.685507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:56.700439 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:56.702118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:23:56.812979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:56.828149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 66/140] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:56.853767 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 75/141] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:23:56.899016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:56.907058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:57.135576 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:57.196567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2453e-5a7d-43ef-a31c-672240ec1342 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:57.237373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c6b17-afe2-4971-b2c0-de25dee76ccd None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:57.337698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:57.338837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:57.339161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:57.339696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:57.341205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:57.343612 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:57.349695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 67/142] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:57.356400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:57.364197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:57.365916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:57.366435 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:57.366539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:57.396273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:23:57.419925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:23:57.420850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:23:57.421676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:23:57.422242 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 76/143] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:23:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:23:57.432711 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:57.549729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:57.578456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c492-d134-430e-a173-c055d2c11ed4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:57.645618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:57.647474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:57.647919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:57.648463 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:57.649863 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:57.652629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:57.686555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae322ace-17dd-4ef3-87c5-19defdafe4be None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:57.716268 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 68/144] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:23:57 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:23:57.790439 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:57.791550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:57.792311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:57.792782 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:57.793812 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:57.794338 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:57.796062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:57.814150 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 77/145] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:57.827821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:57.879059 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:58.077225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1904-622f-4fa4-a21c-110122130586 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:58.163574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:58.164576 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:58.164873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:58.165156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:58.167028 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:58.168570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:58.170502 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 69/146] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:23:57 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:58.184717 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:58.372866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c180a-ad50-4671-a9f3-9117ea09835b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:58.399462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:58.454386 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:58.455125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:58.455410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:58.455686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:58.573592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:58.575328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:58.717729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 78/147] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:58.728807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:58.960749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:59.007884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018103-7f0a-4a6f-81d8-51d2189756ac None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:59.092099 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ab26-306d-41bb-afd4-479651c30154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:59.094934 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ab26-306d-41bb-afd4-479651c30154 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:59.095715 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ab26-306d-41bb-afd4-479651c30154 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:59.096453 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ab26-306d-41bb-afd4-479651c30154 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:59.104651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3ab26-306d-41bb-afd4-479651c30154 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:59.107916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3ab26-306d-41bb-afd4-479651c30154 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:59.111786 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 70/148] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:23:58 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:23:59.118591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:23:59.137015 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:59.289892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c7b3f-a4fc-4128-9254-0e4f68e2957c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:23:59.340104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:23:59.340787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:59.341086 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:59.341362 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:59.342234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=0a9f7fb5dd904c9d89b8d844683f4118) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:23:59.342547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:23:59.344428 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ecd44-e015-4646-9890-588110a64a27 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:23:59.353129 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 79/149] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:23:59 2022] GET /identity/v3/role_assignments?user.id=0a9f7fb5dd904c9d89b8d844683f4118&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:23:59.877882 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3222-6bce-40ba-9cb5-2eaebf7e0878 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:59.878732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3222-6bce-40ba-9cb5-2eaebf7e0878 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:59.879468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3222-6bce-40ba-9cb5-2eaebf7e0878 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:59.882932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 71/150] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:23:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:23:59.889517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553caab-a5c6-4f7f-9e82-59c38d71ce79 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:23:59.889958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553caab-a5c6-4f7f-9e82-59c38d71ce79 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:23:59.890570 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553caab-a5c6-4f7f-9e82-59c38d71ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:23:59.921638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-7553caab-a5c6-4f7f-9e82-59c38d71ce79 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:23:59.923381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-7553caab-a5c6-4f7f-9e82-59c38d71ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:00.025724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 80/151] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:00.072960 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b3222-6bce-40ba-9cb5-2eaebf7e0878 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:00.344368 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b3222-6bce-40ba-9cb5-2eaebf7e0878 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:00.345722 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e88d4-f8e4-4309-b2bf-9e31cc29c125 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:00.346571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e88d4-f8e4-4309-b2bf-9e31cc29c125 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:00.347075 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e88d4-f8e4-4309-b2bf-9e31cc29c125 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:00.348824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 81/152] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:00.372519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:00.373300 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:00.373773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:00.395024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:00.413807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:00.419658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:00.449836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:00.449836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:00.449836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:00.449836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:00.488036 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:00.503011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:00.504127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:00.505566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:00.508209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 72/153] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:00.515395 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:00.533639 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:00.642114 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 82/154] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:00.730029 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b1bb5-6b62-40fb-a4cc-d264a6bbfd8b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:00.737631 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:00.815864 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:00.816569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:00.816859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:00.817139 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:00.817988 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:00.818303 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:00.819794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:00.847847 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 73/155] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:00.855457 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:00.972458 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39cf51-db0f-44f8-a1ee-e0deada0a5ba None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:01.034803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:01.054672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:01.070442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:01.071298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:01.071582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:01.071859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:01.100544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95141c-4e07-4d00-ace9-694827a2405c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:01.108132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:01.121675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:01.122699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:01.123507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 83/156] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:01.129144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:01.194463 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:01.195998 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:01.196467 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:01.196939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] PATH_INFO: `/v3/users/54700039318d4014811e2e0bde5725b6` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:01.204529 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=54700039318d4014811e2e0bde5725b6)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:01.207386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:01.211386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 74/157] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:00 2022] GET /identity/v3/users/54700039318d4014811e2e0bde5725b6 => generated 289 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:01.226681 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:01.376905 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7308ce-ec14-43bc-aa0c-198166adbd63 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:01.466401 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:01.467259 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:01.467542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:01.467814 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:01.468603 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:01.468913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:01.471720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:01.491275 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d60562-7173-4e01-9bed-70954157f7d0 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:01.494733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 84/158] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:01.502862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:01.629348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:01.631431 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:01.631920 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:01.632334 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:01.640577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:01.643386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:01.647469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 75/159] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:01 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:01.647918 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:01.656974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:01.691094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:01.762788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543da7a-cd36-41aa-9ef2-1c3a525ff00d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:01.886127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:01.887537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:01.887981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:01.888377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:01.899466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:01.902097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:01.919279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 85/160] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:01 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:01.920923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:01.992325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114256bd-a365-4180-8446-515b9fbb5719 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:02.089641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79122-7711-434e-ba23-a57c6550d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:02.091178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79122-7711-434e-ba23-a57c6550d995 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.091681 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79122-7711-434e-ba23-a57c6550d995 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.092182 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79122-7711-434e-ba23-a57c6550d995 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261/users/54700039318d4014811e2e0bde5725b6/roles/9d5a697b555842e6ad223ef3d40cb9e0` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.101857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79122-7711-434e-ba23-a57c6550d995 None admin] RBAC: Authorizing `identity:create_grant(project_id=415102e6bd7442b3b94057725e5ab261, user_id=54700039318d4014811e2e0bde5725b6, role_id=9d5a697b555842e6ad223ef3d40cb9e0)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:02.104462 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79122-7711-434e-ba23-a57c6550d995 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:02.129387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 76/161] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:24:01 2022] PUT /identity/v3/projects/415102e6bd7442b3b94057725e5ab261/users/54700039318d4014811e2e0bde5725b6/roles/9d5a697b555842e6ad223ef3d40cb9e0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:24:02.134204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e964-3a21-470d-90db-d194a234efd1 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.134204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e964-3a21-470d-90db-d194a234efd1 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.134204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197e964-3a21-470d-90db-d194a234efd1 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.137548 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 77/162] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:02.144634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34a0f-b878-4a26-a255-e7f664af196e None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.145275 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34a0f-b878-4a26-a255-e7f664af196e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.146475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34a0f-b878-4a26-a255-e7f664af196e None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.148589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 78/163] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:02.155409 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615feea6-1515-451d-b6c9-ac96e789a58b None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.156109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615feea6-1515-451d-b6c9-ac96e789a58b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.156651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615feea6-1515-451d-b6c9-ac96e789a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.195803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-615feea6-1515-451d-b6c9-ac96e789a58b None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:02.197770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-615feea6-1515-451d-b6c9-ac96e789a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:02.276072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b2e88-9095-4557-af57-3e33847a84fc None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:02.329792 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:02.344363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:02.361217 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 79/164] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:02.363030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.363310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.363590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.364915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:02.366192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.366700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.375373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.395050 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:02.395050 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:02.495221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 80/165] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:02.496410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:02.601413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:02.604160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:02.681947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ca327-8fce-4789-a3dd-daff09e8572c None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:02.762443 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:02.775575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 86/166] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 856 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:02.781335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:02.806618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:02.808054 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.808558 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.809381 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.812907 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:02.856728 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:02.888461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:02.889605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:02.890764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:02.891904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 81/167] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:02.892508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:02.913534 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2251-4c5b-4bcc-b546-4a68c29097df None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:02.958911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:02.960064 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:02.960537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:02.960957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:02.975734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:02.984193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:02.985157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:02.985944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:02.988749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 87/168] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:02.990342 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:03.097288 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:03.120467 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206afaa8-36cc-44ec-acbd-e38afca68047 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:03.164954 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:03.165992 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:03.166763 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:03.167328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:03.168381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:03.168951 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:03.170584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:03.182422 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 88/169] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:03.183733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:03.211152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fb85f-35c9-4d3c-96d5-862efc33ae0c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:03.303881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:03.305119 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:03.305759 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:03.307448 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:03.312929 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:03.314856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:03.322759 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 82/170] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:02 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:03.324068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:03.366243 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37007c7-b058-4e8d-9ece-53ab40d1fc46 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:03.448160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:03.450202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:03.452752 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:03.453301 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:03.454277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:03.457219 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:03.463608 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:03.485745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:03.495485 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 89/171] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:03.496888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:03.537961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:03.621166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021a9a8-16d7-4825-be3e-40225dc3f1b9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:03.695369 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adc29d-1279-4a04-8e79-586fcb78c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:03.699793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc29d-1279-4a04-8e79-586fcb78c295 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:03.700288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc29d-1279-4a04-8e79-586fcb78c295 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:03.700710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc29d-1279-4a04-8e79-586fcb78c295 None admin] PATH_INFO: `/v3/users/186dc468057544fb86abd90933430e96` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:03.702564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc29d-1279-4a04-8e79-586fcb78c295 None admin] RBAC: Authorizing `identity:get_user(user_id=186dc468057544fb86abd90933430e96)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:03.705680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc29d-1279-4a04-8e79-586fcb78c295 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:03.708474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 83/172] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:03 2022] GET /identity/v3/users/186dc468057544fb86abd90933430e96 => generated 247 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:03.712135 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7de9-c890-4a42-a4f4-e606f7f3e5df None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:03.713686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7de9-c890-4a42-a4f4-e606f7f3e5df None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:03.714130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7de9-c890-4a42-a4f4-e606f7f3e5df None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:03.717802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 84/173] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:03.720850 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a7de9-c890-4a42-a4f4-e606f7f3e5df None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:03.737744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73beaf9-f3e4-42bd-b9fc-4f7dacd93229 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:03.811679 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:03.812668 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:03.813117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:03.813563 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:03.814821 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] RBAC: Adding query filter params (role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=0a9f7fb5dd904c9d89b8d844683f4118) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:03.815527 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:03.817445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:03.825321 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 90/174] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:03 2022] GET /identity/v3/role_assignments?user.id=0a9f7fb5dd904c9d89b8d844683f4118&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:03.832180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:03.928616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:03.967191 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c186b2f-39f2-42f7-8e8d-4f7814cfcb20 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:04.000890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a7de9-c890-4a42-a4f4-e606f7f3e5df None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:04.010900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819b1ea-e3d8-4dac-81d3-b904e3905217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:04.011914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819b1ea-e3d8-4dac-81d3-b904e3905217 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.012356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819b1ea-e3d8-4dac-81d3-b904e3905217 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.012791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819b1ea-e3d8-4dac-81d3-b904e3905217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.057256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:04.086335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b7a01-9d5f-4508-a15b-8673ae28e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:04.088169 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7a01-9d5f-4508-a15b-8673ae28e958 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.088686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7a01-9d5f-4508-a15b-8673ae28e958 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.089552 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7a01-9d5f-4508-a15b-8673ae28e958 None admin] PATH_INFO: `/v3/users/0a9f7fb5dd904c9d89b8d844683f4118` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.091954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b7a01-9d5f-4508-a15b-8673ae28e958 None admin] RBAC: Authorizing `identity:get_user(user_id=0a9f7fb5dd904c9d89b8d844683f4118)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:04.095335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b7a01-9d5f-4508-a15b-8673ae28e958 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:04.099766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 85/175] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:03 2022] GET /identity/v3/users/0a9f7fb5dd904c9d89b8d844683f4118 => generated 275 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:04.102577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.103131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.103628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.106897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819b1ea-e3d8-4dac-81d3-b904e3905217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:04.108720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819b1ea-e3d8-4dac-81d3-b904e3905217 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:04.146546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:04.149015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:04.221067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:04.289681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 91/176] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:04.292172 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0987e1-b87b-4a73-92d9-839bbf6fde60 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.292740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0987e1-b87b-4a73-92d9-839bbf6fde60 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.293230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0987e1-b87b-4a73-92d9-839bbf6fde60 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.295937 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 92/177] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:04.303528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc878e-a3d6-4d10-9847-fb8994065f99 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.303876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc878e-a3d6-4d10-9847-fb8994065f99 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.304090 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc878e-a3d6-4d10-9847-fb8994065f99 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.305630 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 93/178] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:04.306476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc878e-a3d6-4d10-9847-fb8994065f99 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:04.308990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 86/179] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:04.311573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:04.452123 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042db7d-4801-4a75-80c8-35a3d762eff3 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:04.481256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc878e-a3d6-4d10-9847-fb8994065f99 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:04.491816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:04.512506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c707-f954-460d-8db7-ede5f004f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:04.513493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c707-f954-460d-8db7-ede5f004f3ef None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.513780 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c707-f954-460d-8db7-ede5f004f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.514057 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c707-f954-460d-8db7-ede5f004f3ef None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.515371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c707-f954-460d-8db7-ede5f004f3ef None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:04.516873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c707-f954-460d-8db7-ede5f004f3ef None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:04.518745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 87/180] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:04 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:04.520023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f97d-58d4-4d5a-8087-4d90159ecaa7 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.520862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f97d-58d4-4d5a-8087-4d90159ecaa7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.521291 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f97d-58d4-4d5a-8087-4d90159ecaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.540799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:04.541638 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-63c7f97d-58d4-4d5a-8087-4d90159ecaa7 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:04.542332 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.542809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.542912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-63c7f97d-58d4-4d5a-8087-4d90159ecaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:04.543398 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.606385 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:04.646584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 88/181] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:04.646584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.646584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.646584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.664921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:04.666240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:04.674713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:04.677156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:04.760004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 89/182] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:04.761502 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:04.831356 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:04.873248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 94/183] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:04.882540 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:04.898480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b8528-2942-4aa2-972f-8be151e8120c None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:04.940685 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:04.941843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:04.943175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:04.943735 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:04.956951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:04.966781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:04.967884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:04.968852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:04.970943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 90/184] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:04.971998 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.016712 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:05.078761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d551bac-ac14-4fcd-8ca0-13885e3ec668 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.104022 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2ce6-b327-4b92-bab0-595daa54c3d6 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.117563 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:05.127024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.127839 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.128138 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.128406 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.129271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=186dc468057544fb86abd90933430e96) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:05.129579 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.131309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.138575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 95/185] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:04 2022] GET /identity/v3/role_assignments?user.id=186dc468057544fb86abd90933430e96&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:05.139221 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.173833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.174676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.174960 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.175271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.190277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:05.200067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:05.201709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 91/186] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:05.203149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.309285 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b377a-85e6-4b55-96c3-548bd58d71fb None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.352087 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.352912 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.353264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.353543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.355153 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.356697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.358696 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 96/187] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:05.359567 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.362638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:05.436069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765db19f-f2a0-4fd3-a976-cb1b63ecb392 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.518771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.519714 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.520046 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.521068 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4cc6b-c86e-42e2-b376-1fed728cc0f6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.521701 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] PATH_INFO: `/v3/projects/06b12608f9204a21bdad2f7a736dc73d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.522590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] RBAC: Authorizing `identity:get_project(project_id=06b12608f9204a21bdad2f7a736dc73d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.524197 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.526078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 92/188] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:05 2022] GET /identity/v3/projects/06b12608f9204a21bdad2f7a736dc73d => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:05.527175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.574877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.575974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.576258 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.576536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.577314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:05.577620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.579101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.580306 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:05.593774 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 97/189] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:05.594652 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.681286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a801ec-0947-4394-9f91-22b9b5ba9d93 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.682538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:05.722071 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.722749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.723094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.723994 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.724767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:05.725074 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.726476 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.730843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3d36-bc43-4453-8343-920ff9b53638 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.736565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 93/190] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:05.737882 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.778357 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.779384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.779837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.780293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.781543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.784000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.819959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 98/191] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:05 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:05.820999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:05.910103 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:05.920244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa164-e15e-402b-adb8-8cf35e41ad7b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.963354 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b03f79-05c8-40e8-987e-82896a91e95c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:05.982255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:05.983530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:05.984001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:05.984338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:05.986115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=06b12608f9204a21bdad2f7a736dc73d, user.id=0a9f7fb5dd904c9d89b8d844683f4118) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:05.986674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:05.990743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:05.991252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:06.015004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 94/192] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:05 2022] GET /identity/v3/role_assignments?user.id=0a9f7fb5dd904c9d89b8d844683f4118&scope.project.id=06b12608f9204a21bdad2f7a736dc73d&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:06.015004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:06.028033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4953f-b45c-482c-9732-6a504e47bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:06.029866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4953f-b45c-482c-9732-6a504e47bc0e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.030476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4953f-b45c-482c-9732-6a504e47bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.031112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4953f-b45c-482c-9732-6a504e47bc0e None admin] PATH_INFO: `/v3/users/504e22b847c04e91ad15ca531908e259` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.066560 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4953f-b45c-482c-9732-6a504e47bc0e None admin] RBAC: Authorizing `identity:get_user(user_id=504e22b847c04e91ad15ca531908e259)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:06.072101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4953f-b45c-482c-9732-6a504e47bc0e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:06.075734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 99/193] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:05 2022] GET /identity/v3/users/504e22b847c04e91ad15ca531908e259 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:06.078038 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a79a6-5fa7-4de2-a9f8-25405a5b4e19 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.078538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a79a6-5fa7-4de2-a9f8-25405a5b4e19 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.087833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a79a6-5fa7-4de2-a9f8-25405a5b4e19 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.091181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 100/194] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:06 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:06.092751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a79a6-5fa7-4de2-a9f8-25405a5b4e19 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:06.177909 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba1c3b-5a45-4147-bd89-9f369e15c535 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:06.242619 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3146a6-f960-4870-98bd-710080779b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:06.243494 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3146a6-f960-4870-98bd-710080779b7e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.243781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3146a6-f960-4870-98bd-710080779b7e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.244064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3146a6-f960-4870-98bd-710080779b7e None admin] PATH_INFO: `/v3/users/504e22b847c04e91ad15ca531908e259` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.245413 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3146a6-f960-4870-98bd-710080779b7e None admin] RBAC: Authorizing `identity:get_user(user_id=504e22b847c04e91ad15ca531908e259)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:06.247698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3146a6-f960-4870-98bd-710080779b7e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:06.249544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 95/195] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:06 2022] GET /identity/v3/users/504e22b847c04e91ad15ca531908e259 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:06.250932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.251284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.251587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.272636 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a79a6-5fa7-4de2-a9f8-25405a5b4e19 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:06.282865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:06.284289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:06.332106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:06.333708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:06.335214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.335537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.335903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.406260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 96/196] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:06.407323 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:06.449010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:06.450789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:06.455338 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:06.559002 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c94b2-2aba-47d4-aff8-76421a7681ce None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:06.608048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 101/197] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:06.609964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:06.633481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:06.634165 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.634450 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.634738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.679204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:06.733290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:06.734799 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:06.804231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:06.852004 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac815-e13d-495d-a417-134751af68a5 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:06.899911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:06.901179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:06.901614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:06.902137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:06.916044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:06.922767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 97/198] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:06.925475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:06.926389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:06.927224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:06.928535 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:06.930237 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 102/199] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:06.936400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:07.025468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:07.084912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668d9e-e0fd-462f-94dd-841080475564 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.117810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e1f8-8f4f-4628-b4de-b2847bf244ad None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.136852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.138130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.138714 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.139704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.141625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.143361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:07.146641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 98/200] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:06 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:07.148152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:07.187010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.188410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.189078 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.189672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.191527 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:07.193136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.196076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:07.207730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:07.223548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 103/201] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:07.225439 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:07.293161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212086-4ad2-4af0-9867-94da7e3a24b7 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.335459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:07.347573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.349460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.349914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.350843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.353119 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.355123 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:07.362579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 99/202] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:07 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:07.362579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:07.438786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987807ce-5cf9-4645-9ab4-df81ed9355ec None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.499785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.500460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.500751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.501032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.501901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=504e22b847c04e91ad15ca531908e259) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:07.502225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.503996 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:07.512208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 104/203] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:07 2022] GET /identity/v3/role_assignments?user.id=504e22b847c04e91ad15ca531908e259&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:07.513521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:07.525212 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618f2b4-09f7-44c1-a9ca-a459d03439d4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.611655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.612944 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.613564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.614235 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] PATH_INFO: `/v3/users/54700039318d4014811e2e0bde5725b6` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.616116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] RBAC: Authorizing `identity:get_user(user_id=54700039318d4014811e2e0bde5725b6)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.618056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:07.623045 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 100/204] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:07 2022] GET /identity/v3/users/54700039318d4014811e2e0bde5725b6 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:07.630922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:07.635542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:07.727400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:07.759092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a41c0-b446-48bd-836f-d779154db66f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.803829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7851-2a3e-4eca-8004-aac4c81c7010 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:07.842412 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.843130 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.843421 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.843704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.844579 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] RBAC: Adding query filter params (role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=504e22b847c04e91ad15ca531908e259) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:07.844893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.846416 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:07.862579 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 105/205] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:07 2022] GET /identity/v3/role_assignments?user.id=504e22b847c04e91ad15ca531908e259&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:07.874009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:07.875263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:07.875785 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:07.876309 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:07.968190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:07.969785 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:08.049875 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:08.120483 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 101/206] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:08.129441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:08.284320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1af0-1ef0-4efa-bea8-690ac49b7c80 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:08.322771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:08.335019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f904e58-2d5e-4ecc-bd27-a1732fbd27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:08.335935 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f904e58-2d5e-4ecc-bd27-a1732fbd27fc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:08.336225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f904e58-2d5e-4ecc-bd27-a1732fbd27fc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:08.336633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f904e58-2d5e-4ecc-bd27-a1732fbd27fc None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:08.337845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f904e58-2d5e-4ecc-bd27-a1732fbd27fc None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:08.339435 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f904e58-2d5e-4ecc-bd27-a1732fbd27fc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:08.346393 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 106/207] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:08 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:08.347928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:08.597634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c42ad-0ea7-470b-9a69-717320402f25 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:08.685303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cb97a-156f-4a9e-a031-d9e1a354e870 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:08.685654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cb97a-156f-4a9e-a031-d9e1a354e870 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:08.685896 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cb97a-156f-4a9e-a031-d9e1a354e870 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:08.688182 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 107/208] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:08.693881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:08.695058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:08.695570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:08.696071 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:08.697865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] RBAC: Adding query filter params (role.id=9d5a697b555842e6ad223ef3d40cb9e0, scope.project.id=415102e6bd7442b3b94057725e5ab261, user.id=54700039318d4014811e2e0bde5725b6) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:08.698443 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:08.699039 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d84087-759e-40b6-821b-318ffda967ef None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:08.699430 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d84087-759e-40b6-821b-318ffda967ef None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:08.699746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d84087-759e-40b6-821b-318ffda967ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:08.701948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:08.714554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 102/209] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:08 2022] GET /identity/v3/role_assignments?user.id=54700039318d4014811e2e0bde5725b6&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=9d5a697b555842e6ad223ef3d40cb9e0 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:08.737331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-98d84087-759e-40b6-821b-318ffda967ef None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:08.738625 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-98d84087-759e-40b6-821b-318ffda967ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:08.917826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 108/210] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:08.966522 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:09.028700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:09.184418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1310219-c683-4553-9ea9-71d87bfe5dd2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:09.256539 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b25ae-4838-4cd8-8377-c1202642fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:09.257868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b25ae-4838-4cd8-8377-c1202642fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:09.258370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b25ae-4838-4cd8-8377-c1202642fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:09.258841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b25ae-4838-4cd8-8377-c1202642fbd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:09.261108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b25ae-4838-4cd8-8377-c1202642fbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:09.263830 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b25ae-4838-4cd8-8377-c1202642fbd6 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:09.267226 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 103/211] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:09.276104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d84087-759e-40b6-821b-318ffda967ef None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:09.503190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d84087-759e-40b6-821b-318ffda967ef None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:09.541819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:09.553409 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fffae-ffad-4665-819b-e8a858101c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:09.554101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fffae-ffad-4665-819b-e8a858101c57 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:09.554381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fffae-ffad-4665-819b-e8a858101c57 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:09.554660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fffae-ffad-4665-819b-e8a858101c57 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:09.555430 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fffae-ffad-4665-819b-e8a858101c57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:09.556985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fffae-ffad-4665-819b-e8a858101c57 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:09.590887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 109/212] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:09 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:09.737755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f99b-b8aa-431a-bb34-ca9447ff9a87 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:09.739493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f99b-b8aa-431a-bb34-ca9447ff9a87 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:09.740330 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f99b-b8aa-431a-bb34-ca9447ff9a87 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:09.743358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 104/213] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:09.752918 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:09.753889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:09.755486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:09.788948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:09.792010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:09.937453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 110/214] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:09.983070 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f99b-b8aa-431a-bb34-ca9447ff9a87 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:10.176854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:10.187834 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488f99b-b8aa-431a-bb34-ca9447ff9a87 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:10.233433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:10.234380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:10.234707 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:10.235050 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:10.251510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:10.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:10.262025 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:10.263954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 105/215] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:10.270113 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:10.536811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c8c2-5e4c-4988-87d7-43708a6fae4a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:10.565751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:10.625291 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:10.626457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:10.626925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:10.627414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:10.628833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:10.629908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:10.632731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69700-aa62-46e2-861a-ca2438fd7218 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:10.658864 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 111/216] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:10.668081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:10.806575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f3187-b5bb-4e9c-a6e4-d08561a5c880 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:10.842875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36a57a-edea-4ac4-9d25-3345850a0e89 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:10.843397 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36a57a-edea-4ac4-9d25-3345850a0e89 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:10.844253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36a57a-edea-4ac4-9d25-3345850a0e89 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:10.847117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 112/217] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:10.857893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ab46-a8c7-4284-b455-98126e0c95d4 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:10.858371 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ab46-a8c7-4284-b455-98126e0c95d4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:10.858833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ab46-a8c7-4284-b455-98126e0c95d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:10.874515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:10.876145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:10.876651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:10.886912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] PATH_INFO: `/v3/users/4a421d3a1fb5401ca04ceef85cfe37c1` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:10.911362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a421d3a1fb5401ca04ceef85cfe37c1)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:10.916775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:10.919916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-59c6ab46-a8c7-4284-b455-98126e0c95d4 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:10.921314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-59c6ab46-a8c7-4284-b455-98126e0c95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:10.923977 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 106/218] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:10 2022] GET /identity/v3/users/4a421d3a1fb5401ca04ceef85cfe37c1 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:10.930177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:10.985340 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:11.135652 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 113/219] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:11.187005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca01d-81ba-4ffc-9f00-70c92f8a56e5 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:11.187733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca01d-81ba-4ffc-9f00-70c92f8a56e5 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:11.188225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca01d-81ba-4ffc-9f00-70c92f8a56e5 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:11.193223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 114/220] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:11.195738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca01d-81ba-4ffc-9f00-70c92f8a56e5 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:11.208880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014da03c-70bb-4665-b086-25f4b81739a8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:11.281306 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:11.282397 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:11.282861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:11.283396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:11.335762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca01d-81ba-4ffc-9f00-70c92f8a56e5 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:11.340010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:11.388360 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb0041-dd01-4db4-a3be-3c6cbb5b892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:11.389256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0041-dd01-4db4-a3be-3c6cbb5b892d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:11.389647 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0041-dd01-4db4-a3be-3c6cbb5b892d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:11.390646 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0041-dd01-4db4-a3be-3c6cbb5b892d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:11.406429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb0041-dd01-4db4-a3be-3c6cbb5b892d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-1dfb0041-dd01-4db4-a3be-3c6cbb5b892d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:11.420867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:11.422829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:11.424959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:11.430113 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 115/221] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:11.432365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:11.433109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:11.433878 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:11.434039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:11.435205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:11.452770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:11.476192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:11.477461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:11.577984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 116/222] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:11.579155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:11.631481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 107/223] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:11.639133 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:11.713481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:11.722066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd1e5-ac98-4930-9833-7bac03593944 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:11.766466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:11.767191 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:11.767482 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:11.767758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:11.768543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:11.768855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:11.770469 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:11.781545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 117/224] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:11.782964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:11.852938 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f11843-3256-4e6c-8bdf-3b5b86b38c89 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:11.873806 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:11.902928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:11.904318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:11.904914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:11.905402 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:11.919288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:11.929900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:11.930843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:11.931688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:11.934306 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 108/225] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:11.935424 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:11.988287 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b83ac-a53e-4b37-8479-6fa4010a6fe6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.058058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.059802 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.060414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.061019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.064011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.068091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.072066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 118/226] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:11 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:12.077161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:12.080808 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1830a1-35af-4043-8ee2-00829f2e3473 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.124662 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.125992 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:12.127213 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.127732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.128342 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] PATH_INFO: `/v3/users/504e22b847c04e91ad15ca531908e259` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.131990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] RBAC: Authorizing `identity:get_user(user_id=504e22b847c04e91ad15ca531908e259)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.134050 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.136851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 109/227] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:11 2022] GET /identity/v3/users/504e22b847c04e91ad15ca531908e259 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:12.138048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:12.194288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:12.270670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7de4e3-607a-4675-a310-216e495ff538 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.273736 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3093ca-38c5-4a28-b193-eeb5b20fe200 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.341743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.342867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.343400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.343946 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.345278 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:12.345800 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.348761 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.348997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.350548 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.351403 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.352310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.354475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=4a421d3a1fb5401ca04ceef85cfe37c1) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:12.355473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.358818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.366302 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 119/228] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:12.371259 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 110/229] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:12 2022] GET /identity/v3/role_assignments?user.id=4a421d3a1fb5401ca04ceef85cfe37c1&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:12.377962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:12.393097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:12.621844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:12.638210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aab19e-0d67-4033-90c8-1203232256a2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.682859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.683797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.684083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.684381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.685761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.687598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.689479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 120/230] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:12 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:12.696013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:12.756685 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59a131-e892-4495-bcb6-8ed711b990fb None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.787405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:12.835083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cabd11-ce4d-4e2f-8af4-5f451c5e9751 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:12.847930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.849389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.849667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.850090 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] PATH_INFO: `/v3/users/504e22b847c04e91ad15ca531908e259` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.851540 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] RBAC: Authorizing `identity:get_user(user_id=504e22b847c04e91ad15ca531908e259)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.853032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.854781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 111/231] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:12 2022] GET /identity/v3/users/504e22b847c04e91ad15ca531908e259 => generated 283 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:12.860748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:12.893433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c44fb-80be-4bef-a6af-9d55f46f3b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:12.894417 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c44fb-80be-4bef-a6af-9d55f46f3b86 None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:12.894780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c44fb-80be-4bef-a6af-9d55f46f3b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:12.895111 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c44fb-80be-4bef-a6af-9d55f46f3b86 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/504e22b847c04e91ad15ca531908e259/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:12.900651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c44fb-80be-4bef-a6af-9d55f46f3b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=916ca130ed7f4f009c1917a7f0e7c907, user_id=504e22b847c04e91ad15ca531908e259, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:12.902259 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c44fb-80be-4bef-a6af-9d55f46f3b86 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:12.955017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 121/232] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:24:12 2022] PUT /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/504e22b847c04e91ad15ca531908e259/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:13.131910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb6a29-5122-4790-83db-c258530737b3 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:13.240288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:13.242521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.243426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.244193 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.247119 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:13.250303 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:13.252996 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c210-deec-46bd-906f-d4abea588144 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.253419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c210-deec-46bd-906f-d4abea588144 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.253567 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c210-deec-46bd-906f-d4abea588144 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.259974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 122/233] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:13.261927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.262205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.262503 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.267422 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 112/234] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:12 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:13.283917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:13.298486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:13.299839 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:13.326190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:13.369967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:13.485716 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 123/235] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:13.505316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d436f-b15d-496f-8ea2-a4a3adf5c502 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:13.562524 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:13.588957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:13.591017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.591838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.592731 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/504e22b847c04e91ad15ca531908e259/roles/7ec579bc6ca745cea09c4d5f57d4663d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.604477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=916ca130ed7f4f009c1917a7f0e7c907, user_id=504e22b847c04e91ad15ca531908e259, role_id=7ec579bc6ca745cea09c4d5f57d4663d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:13.608181 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:13.648130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 113/236] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:24:13 2022] PUT /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/504e22b847c04e91ad15ca531908e259/roles/7ec579bc6ca745cea09c4d5f57d4663d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:24:13.697157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379678ea-24dc-45f2-bbcf-e34c27d52e30 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:13.746966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897f46c-8ccd-490c-8ca9-13ffbca62b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:13.747812 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f46c-8ccd-490c-8ca9-13ffbca62b98 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.748094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f46c-8ccd-490c-8ca9-13ffbca62b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.748369 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f46c-8ccd-490c-8ca9-13ffbca62b98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.749752 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f46c-8ccd-490c-8ca9-13ffbca62b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:13.751312 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f46c-8ccd-490c-8ca9-13ffbca62b98 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:13.753476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 124/237] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:13.760715 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:13.807521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618ea1-eeab-4589-9b11-fb8cb8012623 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.807942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618ea1-eeab-4589-9b11-fb8cb8012623 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.808117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618ea1-eeab-4589-9b11-fb8cb8012623 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.809818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 125/238] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:13.830560 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:13.830850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:13.831181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:13.862943 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:13.865275 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:13.883356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:13.979890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a7ac-2912-41bd-981b-ff6b4363beb2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:13.983368 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:14.016395 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 126/239] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:14.048204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:14.049834 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:14.050598 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:14.051818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:14.053343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:14.056572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:14.058288 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:14.096211 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 114/240] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:13 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:24:14.255050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2d584-b97f-4f62-889b-2e74ebb10af9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:14.318320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:14.319107 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:14.319402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:14.319683 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:14.339414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:14.347546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:14.349348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:14.350128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 127/241] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:14.357467 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:14.594131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3025-aa6c-4126-8a88-e5261e6b5814 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:14.681669 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:14.682375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:14.686060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:14.686060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:14.686550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:14.686835 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:14.688302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:14.710670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 115/242] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:14.716877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:14.721864 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:14.916476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5fa05-3325-4473-9158-5c001f0c9da2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:14.993463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:14.995542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:14.996356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:14.997150 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] PATH_INFO: `/v3/users/175bc43a81eb4c26a6a70d6e4ec42da8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:15.026774 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] RBAC: Authorizing `identity:get_user(user_id=175bc43a81eb4c26a6a70d6e4ec42da8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:15.030377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:15.034730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 128/243] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:14 2022] GET /identity/v3/users/175bc43a81eb4c26a6a70d6e4ec42da8 => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:15.042458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:15.087656 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:15.208359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1cf0-2be0-4243-b5b7-ff2081e35f03 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:15.256604 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:15.257276 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:15.257559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:15.257833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:15.376706 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:15.378304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:15.416570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:15.663878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 116/244] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:15.670668 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:15.807424 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:15.896315 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0e126-4fb3-40da-aa93-48323abe3a8f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:15.980442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aae09d-f20e-487b-88f8-0b080a3ef530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:15.981938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aae09d-f20e-487b-88f8-0b080a3ef530 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:15.982433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aae09d-f20e-487b-88f8-0b080a3ef530 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:15.982931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aae09d-f20e-487b-88f8-0b080a3ef530 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:15.985630 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aae09d-f20e-487b-88f8-0b080a3ef530 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:15.989062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aae09d-f20e-487b-88f8-0b080a3ef530 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:15.992759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 129/245] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:15 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:15.999640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:16.250647 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c4f9e-f566-4bd6-8721-fe8a0987bf56 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:16.306472 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:16.343511 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:16.344647 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:16.345144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:16.345638 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:16.347296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] RBAC: Adding query filter params (role.id=9d5a697b555842e6ad223ef3d40cb9e0, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=175bc43a81eb4c26a6a70d6e4ec42da8) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:16.351460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:16.351460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb634b-53d4-4290-9736-2bb81be17f88 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:16.367312 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 117/246] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:15 2022] GET /identity/v3/role_assignments?user.id=175bc43a81eb4c26a6a70d6e4ec42da8&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=9d5a697b555842e6ad223ef3d40cb9e0 => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:16.711725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1880c-7401-4196-b897-2cef505fcb4b None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:16.711725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1880c-7401-4196-b897-2cef505fcb4b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:16.711725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1880c-7401-4196-b897-2cef505fcb4b None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:16.713125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 130/247] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:16.724130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136284-c1e6-4267-8515-27d5af1d2826 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:16.724659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136284-c1e6-4267-8515-27d5af1d2826 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:16.725089 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136284-c1e6-4267-8515-27d5af1d2826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:16.769285 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-32136284-c1e6-4267-8515-27d5af1d2826 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:16.772068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-32136284-c1e6-4267-8515-27d5af1d2826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:16.934415 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 118/248] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:17.010146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1880c-7401-4196-b897-2cef505fcb4b None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:17.150421 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe486f-4bac-4e95-b023-a96f7ffa0424 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.150922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe486f-4bac-4e95-b023-a96f7ffa0424 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.151456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe486f-4bac-4e95-b023-a96f7ffa0424 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.154264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 119/249] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:17.162229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.162733 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.163267 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.197384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:17.199775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:17.235817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1880c-7401-4196-b897-2cef505fcb4b None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:17.311622 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:17.339660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 120/250] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:17.358391 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:17.359671 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.360119 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.360548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.368365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:17.412116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:17.433020 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:17.433984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:17.434756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:17.439256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 131/251] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:17.439471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:17.448685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:17.524622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd347-a5ed-4281-950e-81fa9a4a89a9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:17.570583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:17.571387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.571681 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.571969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.587280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:17.595905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:17.596925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:17.597947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 121/252] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:17.606646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:17.760141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35e2c-4ba5-46cb-8106-1d18f71e2b76 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:17.763533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:17.805929 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:17.806641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.806935 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.807362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.808188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:17.808507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:17.810096 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:17.820747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 122/253] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:17.826507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:17.879979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5a3a-2ee1-4af9-942a-5fbd69cda9ae None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:17.954676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91f59-eef0-45b8-a6eb-76f180511e63 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:17.990100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:17.993080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:17.993080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:17.993080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:17.993650 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:17.994170 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.004990 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:18.027916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:18.029285 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.029883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.030158 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 132/254] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:18.031251 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] PATH_INFO: `/v3/users/504e22b847c04e91ad15ca531908e259` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.034544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] RBAC: Authorizing `identity:get_user(user_id=504e22b847c04e91ad15ca531908e259)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.037707 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:18.037872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:18.040550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 123/255] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:17 2022] GET /identity/v3/users/504e22b847c04e91ad15ca531908e259 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:18.049087 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:18.128426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.136673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.241594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba29f-df36-4b79-bf5b-ef1129c82a4f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:18.304600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:18.305454 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.305738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.306006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] PATH_INFO: `/v3/users/4a421d3a1fb5401ca04ceef85cfe37c1` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.311977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] RBAC: Authorizing `identity:get_user(user_id=4a421d3a1fb5401ca04ceef85cfe37c1)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.313547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:18.315801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 133/256] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:18 2022] GET /identity/v3/users/4a421d3a1fb5401ca04ceef85cfe37c1 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:18.326256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:18.357335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd69a8a-fb12-4e76-bbda-04ea53e6303d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:18.530799 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991e9f3-0ea6-43f1-835b-729a751fda58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:18.531661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991e9f3-0ea6-43f1-835b-729a751fda58 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.531810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991e9f3-0ea6-43f1-835b-729a751fda58 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.532093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991e9f3-0ea6-43f1-835b-729a751fda58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.594364 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719db2e4-4c71-4585-866b-e067f720571e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:18.624218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.648444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38384d-de16-4909-8c60-fed0f3944155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:18.649445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38384d-de16-4909-8c60-fed0f3944155 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.649740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38384d-de16-4909-8c60-fed0f3944155 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.650021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38384d-de16-4909-8c60-fed0f3944155 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.651714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38384d-de16-4909-8c60-fed0f3944155 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.653082 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38384d-de16-4909-8c60-fed0f3944155 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:18.655735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 134/257] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:18 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:18.663266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59edc-ef7e-4561-90ac-aeaff7de49ea None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.663266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59edc-ef7e-4561-90ac-aeaff7de49ea None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.663266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59edc-ef7e-4561-90ac-aeaff7de49ea None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.663266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 135/258] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:18.663266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40425b94-cdd5-410c-b8ae-1a1a5d94605f None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.663266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40425b94-cdd5-410c-b8ae-1a1a5d94605f None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.664072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40425b94-cdd5-410c-b8ae-1a1a5d94605f None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.664072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 136/259] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:18.669128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.669522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.669747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.689406 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:18.690585 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:18.738128 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991e9f3-0ea6-43f1-835b-729a751fda58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.741838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991e9f3-0ea6-43f1-835b-729a751fda58 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:18.794467 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 137/260] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:18.795426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:18.830291 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.912501 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 124/261] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:18.914067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.914429 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.914774 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.933874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:18.935384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:18.943289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a8f6-0b57-4a90-85b5-7d28a5b90143 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:18.965242 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:18.989234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:18.990550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:18.991010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:18.991499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/4a421d3a1fb5401ca04ceef85cfe37c1/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:18.993986 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] RBAC: Authorizing `identity:create_grant(project_id=916ca130ed7f4f009c1917a7f0e7c907, user_id=4a421d3a1fb5401ca04ceef85cfe37c1, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:18.996065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:19.015157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 138/262] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:24:18 2022] PUT /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/4a421d3a1fb5401ca04ceef85cfe37c1/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:19.016573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:19.027287 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 125/263] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:19.028624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:19.198517 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:19.283627 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7ecd2-2fbd-415b-8869-4f3fe8aa6105 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:19.315534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41acf63-1c96-4231-9009-e9ef9b0414f9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:19.342012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:19.342848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.343164 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.343443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.358248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:19.368137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:19.369095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:19.369874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 139/264] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:19.370528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:19.405911 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d9de6-709b-47f7-a098-17491a9ecf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:19.408469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9de6-709b-47f7-a098-17491a9ecf0c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.408969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9de6-709b-47f7-a098-17491a9ecf0c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.409947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9de6-709b-47f7-a098-17491a9ecf0c None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.413315 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d9de6-709b-47f7-a098-17491a9ecf0c None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:19.417469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d9de6-709b-47f7-a098-17491a9ecf0c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:19.422113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 126/265] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:19.426524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f8e5-0130-4f19-a538-96b98fb41469 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.427082 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f8e5-0130-4f19-a538-96b98fb41469 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.427556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f8e5-0130-4f19-a538-96b98fb41469 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.436726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 127/266] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:19.439080 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f8e5-0130-4f19-a538-96b98fb41469 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:19.443052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:19.537981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130261f2-9bbd-405d-aa07-3268e929827c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:19.583074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:19.584103 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.584388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.584662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.598800 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:19.607680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:19.608780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:19.609545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 140/267] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:19.610215 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:19.703262 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f8e5-0130-4f19-a538-96b98fb41469 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:19.761461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:19.768396 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279920e-d8d1-48ec-9fcc-48c08c1d8a99 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:19.775620 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:19.782633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:19.783426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.783816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.784196 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.786434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:19.789636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:19.791592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b4fa9-ec52-4995-8f79-0182fb50105e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:19.809781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 128/268] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:19.809781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.809781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.809781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.824946 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:19.825982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:19.826428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:19.826643 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:19.827140 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:19.827946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:19.828381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=504e22b847c04e91ad15ca531908e259) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:19.828866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:19.830572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:19.838561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 141/269] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/role_assignments?user.id=504e22b847c04e91ad15ca531908e259&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:19.839820 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:19.972985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb46ee-a5ce-4c20-aa76-d7d8540f40f7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:19.974808 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 129/270] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:19.975768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:20.018772 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:20.020516 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.021023 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.021494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.022500 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:20.023102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:20.024924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:20.036015 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 142/271] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:20.037380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:20.073791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:20.176541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d463d1-f2af-47a4-94c5-04c8a73ec9b4 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:20.221481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:20.223034 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.223572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.224045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.225679 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:20.227730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:20.229876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 143/272] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:20.231180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:20.315708 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d97f0-b5b1-457e-a5c4-3f1111793ba6 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:20.354367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:20.375636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:20.377424 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.377903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.379971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] PATH_INFO: `/v3/users/1e47c20dea4f470c956600cc10f0317d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.397995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:20.409531 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] RBAC: Authorizing `identity:get_user(user_id=1e47c20dea4f470c956600cc10f0317d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:20.412584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:20.419993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 130/273] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:19 2022] GET /identity/v3/users/1e47c20dea4f470c956600cc10f0317d => generated 293 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:20.419993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:20.420558 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e417b65-76c3-4714-8670-f8a1765d7c76 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:20.490148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62008-2963-45b3-8efd-9179cf4b60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:20.490148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62008-2963-45b3-8efd-9179cf4b60b8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.490148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62008-2963-45b3-8efd-9179cf4b60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.490148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62008-2963-45b3-8efd-9179cf4b60b8 None admin] PATH_INFO: `/v3/users/504e22b847c04e91ad15ca531908e259` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.491511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e62008-2963-45b3-8efd-9179cf4b60b8 None admin] RBAC: Authorizing `identity:get_user(user_id=504e22b847c04e91ad15ca531908e259)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:20.493510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e62008-2963-45b3-8efd-9179cf4b60b8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:20.494946 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 144/274] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:20 2022] GET /identity/v3/users/504e22b847c04e91ad15ca531908e259 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:20.496298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391034f-5453-428b-a485-0f46f2bc70b6 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.496594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391034f-5453-428b-a485-0f46f2bc70b6 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.496871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391034f-5453-428b-a485-0f46f2bc70b6 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.502725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 145/275] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:20.502725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391034f-5453-428b-a485-0f46f2bc70b6 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:20.611288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5adf5-91c6-46fc-8ad1-948e796d15ef None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:20.631457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391034f-5453-428b-a485-0f46f2bc70b6 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:20.670735 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:20.671458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.671743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.672019 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.672750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:20.674239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:20.679462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:20.680461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.680923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.681373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.682441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, user.id=1e47c20dea4f470c956600cc10f0317d, scope.system=all) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:20.682998 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:20.684686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325f1e-0f4a-4fa8-b220-d3ac4624e9c3 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:20.694653 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 146/276] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jul 14 14:24:20 2022] GET /identity/v3/role_assignments?user.id=1e47c20dea4f470c956600cc10f0317d&scope.system=all&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:20.696557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:20.697034 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:20.697313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:20.714838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 131/277] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:20 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:20.716406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:20.719472 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:20.721025 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:20.772419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:20.815426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:20.943198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 147/278] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:20.954862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996840ea-05cd-4d09-afb3-bbc172cb3407 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:20.975678 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:21.044317 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:21.046605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:21.047402 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:21.048132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:21.167609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6e11b-9531-4a94-a199-a037e994c884 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:21.186138 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:21.189227 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:21.239477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:21.240845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:21.241444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:21.241773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:21.266032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:21.270132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:21.283657 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:21.293165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:21.294915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 148/279] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:21.298514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:21.338088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:21.414749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 132/280] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:21.424481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:21.527939 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c326d-8649-4675-84e8-5bd43e32743e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:21.609495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:21.610783 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:21.611442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:21.612892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:21.614160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:21.614807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:21.617761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:21.633795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 149/281] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:21.644699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:21.668857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d4b73-9fd8-4711-8cec-61f8b06d39ec None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:21.775165 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:21.777046 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:21.778745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:21.779456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:21.782100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:21.786412 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:21.790297 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 133/282] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:21 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:21.801152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:21.835274 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:21.907496 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:21.990349 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2360ba0-4745-4fc7-b21e-d022325e0a9d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:22.061461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:22.063343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:22.064000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:22.064846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] PATH_INFO: `/v3/users/175bc43a81eb4c26a6a70d6e4ec42da8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:22.068018 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] RBAC: Authorizing `identity:get_user(user_id=175bc43a81eb4c26a6a70d6e4ec42da8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:22.071015 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:22.074506 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 150/283] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:21 2022] GET /identity/v3/users/175bc43a81eb4c26a6a70d6e4ec42da8 => generated 297 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:22.082150 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:22.119402 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07868-0992-4e85-b713-b4d6e38d7b28 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:22.256210 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:22.257285 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:22.257762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:22.258230 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:22.259786 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] RBAC: Adding query filter params (role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=504e22b847c04e91ad15ca531908e259) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:22.260318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:22.262907 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4976d-dd04-48a5-a7be-7f6a34994202 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:22.282546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 134/284] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:21 2022] GET /identity/v3/role_assignments?user.id=504e22b847c04e91ad15ca531908e259&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 608 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:22.284921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef7a11-cc09-40ba-a6d5-ec679f569574 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:22.285399 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef7a11-cc09-40ba-a6d5-ec679f569574 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:22.285872 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef7a11-cc09-40ba-a6d5-ec679f569574 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:22.297797 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 135/285] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:22.304896 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dbdbd-03bb-43cf-9dfd-9cdf0ec37bfa None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:22.313991 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:22.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:22.365031 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:22.367026 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:22.376293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:22.378155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:22.383593 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:22.384930 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:22.390070 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:22.393259 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:22.398293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 151/286] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:22 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:22.404578 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:22.453514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:22.617640 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499427d0-9a1e-4cfb-b725-df696045edbc None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:22.651485 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:22.676788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:22.677720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:22.678003 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:22.678280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/175bc43a81eb4c26a6a70d6e4ec42da8/roles/9d5a697b555842e6ad223ef3d40cb9e0` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:22.680464 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] RBAC: Authorizing `identity:create_grant(project_id=916ca130ed7f4f009c1917a7f0e7c907, user_id=175bc43a81eb4c26a6a70d6e4ec42da8, role_id=9d5a697b555842e6ad223ef3d40cb9e0)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:22.681322 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 136/287] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:22.682299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:22.713459 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 152/288] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:24:22 2022] PUT /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/users/175bc43a81eb4c26a6a70d6e4ec42da8/roles/9d5a697b555842e6ad223ef3d40cb9e0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:22.734337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:22.973490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ecaff-7e6e-43b5-9cab-aba5227a16bf None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:23.019748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:23.020575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:23.020858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:23.021133 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:23.035386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:23.043971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:23.044932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:23.045746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 137/289] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:23.054147 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:23.208078 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:23.260225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b255b1-ab50-48b6-b5a5-9b5058a4ae89 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:23.328352 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:23.329371 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:23.329795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:23.330184 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:23.331324 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:23.331898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:23.334097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:23.350356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 153/290] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:23.359131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:23.528040 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:23.642021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d31c5-6d92-499c-aba0-351e453644af None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:23.731468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:23.732821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:23.733238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:23.733644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] PATH_INFO: `/v3/users/4a421d3a1fb5401ca04ceef85cfe37c1` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:23.737225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a421d3a1fb5401ca04ceef85cfe37c1)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:23.740189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:23.744437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 138/291] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:23 2022] GET /identity/v3/users/4a421d3a1fb5401ca04ceef85cfe37c1 => generated 297 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:23.752829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:23.963604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec11061-2b21-420f-9299-0e0648a8fe56 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:24.011379 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:24.016800 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:24.017473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.017765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.018366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.123702 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:24.125202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:24.275044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 154/292] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:24.284082 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:24.454425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3679-0681-4811-a30e-8dd3328002e8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:24.492398 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:24.504277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff5bdd-fac4-4a41-87f6-adf2ec8474c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:24.505238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5bdd-fac4-4a41-87f6-adf2ec8474c0 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.505624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5bdd-fac4-4a41-87f6-adf2ec8474c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.505978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5bdd-fac4-4a41-87f6-adf2ec8474c0 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.507551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff5bdd-fac4-4a41-87f6-adf2ec8474c0 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:24.509066 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff5bdd-fac4-4a41-87f6-adf2ec8474c0 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:24.511177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 139/293] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:24 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:24.520506 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:24.577538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:24.726381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67793088-9289-4854-b8fc-3c987a6945b8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:24.727624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446e64-029a-4dd4-8196-44082453753f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.728428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446e64-029a-4dd4-8196-44082453753f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.729203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446e64-029a-4dd4-8196-44082453753f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.739018 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 140/294] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:24.741930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.742922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.743547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.784672 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:24.787332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:24.789318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:24.790095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.790407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.790814 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.791895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=4a421d3a1fb5401ca04ceef85cfe37c1) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:24.792264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:24.793986 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4c71-6413-421f-bfca-9d39cf0c0905 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:24.818504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 155/295] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:24 2022] GET /identity/v3/role_assignments?user.id=4a421d3a1fb5401ca04ceef85cfe37c1&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:24.937715 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 141/296] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:24.960939 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4731c5-2be0-494b-a705-9dca0d023c3b None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.961231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4731c5-2be0-494b-a705-9dca0d023c3b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.961680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4731c5-2be0-494b-a705-9dca0d023c3b None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:24.963667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 156/297] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:24.971429 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:24.976011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:24.976392 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:24.976568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.009226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:25.012031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:25.151252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 157/298] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:25.155265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e80fa-b58e-4086-a0a0-cc86f72bfa65 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:25.189342 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:25.210137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:25.233484 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:25.234805 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.235330 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.235809 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.241029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:25.262405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:25.283127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:25.284106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:25.285857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:25.286456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 142/299] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:25.296825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:25.391375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae1f6-471f-4262-b39f-0502e162dbff None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:25.469079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:25.469823 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.470144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.470419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.476367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:25.480253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:25.490601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56ec46-2bf7-40d0-a4d2-4f2b4427033c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:25.491368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 158/300] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:25.494598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:25.579404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:25.580867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.583078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.583874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.585572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:25.586333 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:25.589365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:25.609052 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 143/301] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:25.619702 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:25.711781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:25.728788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95a4e-fb03-4b45-9b06-9f5c9ac585f2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:25.735350 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:25.808766 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163d97-5181-468a-bccd-8d851ca04e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:25.809986 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163d97-5181-468a-bccd-8d851ca04e1a None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.810586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163d97-5181-468a-bccd-8d851ca04e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.811129 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163d97-5181-468a-bccd-8d851ca04e1a None admin] PATH_INFO: `/v3/groups` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.812380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4cbba-fb70-48fa-9ebc-0bd38f3bf607 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:25.812549 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163d97-5181-468a-bccd-8d851ca04e1a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:25.815126 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163d97-5181-468a-bccd-8d851ca04e1a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:25.838742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 159/302] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Jul 14 14:24:25 2022] POST /identity/v3/groups => generated 229 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:25.840565 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ca150-d79f-4cf0-aead-7b46509f5dc4 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.841090 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ca150-d79f-4cf0-aead-7b46509f5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.841569 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ca150-d79f-4cf0-aead-7b46509f5dc4 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.843282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 160/303] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:25.857002 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.857619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.858613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.872610 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:25.873920 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:25.874446 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:25.875150 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] PATH_INFO: `/v3/users/1e47c20dea4f470c956600cc10f0317d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:25.876884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] RBAC: Authorizing `identity:get_user(user_id=1e47c20dea4f470c956600cc10f0317d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:25.878707 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:25.880927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 144/304] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:25 2022] GET /identity/v3/users/1e47c20dea4f470c956600cc10f0317d => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:25.892999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:25.895290 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:25.896011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.031575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 161/305] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:26.051197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.123810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a36ee0-2168-417e-a3a7-8358443a425b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:26.155896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:26.161893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:26.187739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e051f-5f64-41e8-abc2-6a2645f916f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:26.188623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e051f-5f64-41e8-abc2-6a2645f916f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.188908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e051f-5f64-41e8-abc2-6a2645f916f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.189551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e051f-5f64-41e8-abc2-6a2645f916f2 None admin] PATH_INFO: `/v3/system/users/1e47c20dea4f470c956600cc10f0317d/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.189836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f174e-6b6e-4ce7-9ea7-2dd8bd3a0391 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:26.191887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e051f-5f64-41e8-abc2-6a2645f916f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e47c20dea4f470c956600cc10f0317d, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:26.193346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e051f-5f64-41e8-abc2-6a2645f916f2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:26.207420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 145/306] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Jul 14 14:24:25 2022] PUT /identity/v3/system/users/1e47c20dea4f470c956600cc10f0317d/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:26.210427 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fdc81-faa3-492d-8c05-95cda874cd75 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.210933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fdc81-faa3-492d-8c05-95cda874cd75 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.211520 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fdc81-faa3-492d-8c05-95cda874cd75 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.214348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 146/307] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:26.224539 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.225204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.225819 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.246859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:26.247962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.248492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.248914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.261160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:26.263976 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:26.264740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:26.275977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:26.276969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:26.277784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:26.280035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 162/308] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:26.288269 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.450842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 147/309] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:26.496518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.501321 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686cc47-8f52-455a-9a0f-17db1bbf117b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:26.572050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:26.573226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.573711 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.574186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.575789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:26.576322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:26.579112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:26.599550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 163/310] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:26.610395 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.631056 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:26.732076 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe937d8-f354-4242-b0a7-716932f0dd65 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:26.756102 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:26.778856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbdfb9-b332-46cf-b347-9eae20c2a0fe None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:26.805715 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:26.807474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.808140 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.808804 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.824108 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:26.825016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:26.825385 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:26.826092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] PATH_INFO: `/v3/users/2edd27a09a7c496ca03924947ded606d` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:26.832307 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:26.843916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] RBAC: Authorizing `identity:get_user(user_id=2edd27a09a7c496ca03924947ded606d)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:26.845480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:26.855008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 164/311] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:26 2022] GET /identity/v3/users/2edd27a09a7c496ca03924947ded606d => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:26.855242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:26.856722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:26.858177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 148/312] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:26.866484 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.866936 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:26.948823 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:26.994544 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b82434-efe0-4e53-8241-324aea468131 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:27.035175 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:27.035791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.036068 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.036348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.037210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] RBAC: Adding query filter params (role.id=9d5a697b555842e6ad223ef3d40cb9e0, user.id=2edd27a09a7c496ca03924947ded606d, scope.system=all) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:27.037521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:27.039052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:27.045737 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 165/313] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jul 14 14:24:26 2022] GET /identity/v3/role_assignments?user.id=2edd27a09a7c496ca03924947ded606d&scope.system=all&role.id=9d5a697b555842e6ad223ef3d40cb9e0 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:27.068995 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7339b-3324-4976-93c7-3ccbbf4fc683 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:27.131202 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:27.132978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.133896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.134675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.136514 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:27.137556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:27.140910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:27.162198 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 149/314] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:27.171828 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:27.395817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acbf8-540d-4a73-9158-e9fadda8f17b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:27.468045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:27.476263 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:27.477509 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.478024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.478494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] PATH_INFO: `/v3/users/175bc43a81eb4c26a6a70d6e4ec42da8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.480094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] RBAC: Authorizing `identity:get_user(user_id=175bc43a81eb4c26a6a70d6e4ec42da8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:27.481781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:27.484205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 166/315] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:27 2022] GET /identity/v3/users/175bc43a81eb4c26a6a70d6e4ec42da8 => generated 297 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:27.493054 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:27.532061 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:27.618732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4617a-c1cd-4665-8d05-08db6d44cbb3 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:27.661030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:27.662069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:27.662548 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:27.663053 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:27.747952 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:27.749787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:27.786151 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:27.867974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 150/316] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:27.873561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:28.062350 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674652-8be4-48f3-b02b-7ff917128eac None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:28.130098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9ab0-66b3-4c98-a92a-f64237bdc6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:28.131689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9ab0-66b3-4c98-a92a-f64237bdc6b6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:28.132199 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9ab0-66b3-4c98-a92a-f64237bdc6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:28.132688 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9ab0-66b3-4c98-a92a-f64237bdc6b6 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:28.134429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9ab0-66b3-4c98-a92a-f64237bdc6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:28.137262 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9ab0-66b3-4c98-a92a-f64237bdc6b6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:28.141094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 167/317] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:27 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:28.148406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:28.268761 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a6aa-2571-4b6f-a7b5-141a298e3193 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:28.304349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:28.310432 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:28.311144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:28.311425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:28.311696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:28.312601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] RBAC: Adding query filter params (role.id=9d5a697b555842e6ad223ef3d40cb9e0, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907, user.id=175bc43a81eb4c26a6a70d6e4ec42da8) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:28.312853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:28.314324 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716b848-c491-4a8b-acb6-16cf8e2acb2a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:28.321899 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 151/318] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:24:28 2022] GET /identity/v3/role_assignments?user.id=175bc43a81eb4c26a6a70d6e4ec42da8&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=9d5a697b555842e6ad223ef3d40cb9e0 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:28.772584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18286b-0d90-4ea5-821a-de5969c9b593 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:28.772974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18286b-0d90-4ea5-821a-de5969c9b593 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:28.773151 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18286b-0d90-4ea5-821a-de5969c9b593 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:28.774701 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 168/319] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:28.780596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:28.781149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:28.781149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:28.800745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:28.802072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:28.883464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 152/320] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:28.909073 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18286b-0d90-4ea5-821a-de5969c9b593 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:28.995038 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:29.046683 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18286b-0d90-4ea5-821a-de5969c9b593 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:29.090807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:29.091720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.092128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.092380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.106017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:29.114748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:29.116554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:29.118180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 169/321] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:29.131006 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:29.272648 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9d5a6-885a-42e9-9b28-bd44c8514ff9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:29.308299 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:29.321287 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:29.321973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.322241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.322518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.323334 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:29.323629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:29.325084 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012f3d-b8e5-4c66-8b52-f6a3bc224758 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:29.337834 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 153/322] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:29.344374 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:29.365718 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20874b5f-390e-4593-8bb2-9180df593f3c None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.366032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20874b5f-390e-4593-8bb2-9180df593f3c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.366286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20874b5f-390e-4593-8bb2-9180df593f3c None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.367915 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 154/323] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:29.373975 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.374267 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.374556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.397897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:29.399379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:29.513951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 155/324] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:29.526016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c0d3-3fe0-4a77-8bfd-4a9130cdbfc8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:29.544914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:29.572888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:29.590299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:29.591356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.591645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.592039 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] PATH_INFO: `/v3/users/1e47c20dea4f470c956600cc10f0317d` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.593453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=1e47c20dea4f470c956600cc10f0317d)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:29.594958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:29.604944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 170/325] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:29 2022] GET /identity/v3/users/1e47c20dea4f470c956600cc10f0317d => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:29.606148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:29.693821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ebe6-f234-4dab-9355-fe58aed4441a None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:29.731599 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:29.756559 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4f3a-d644-43a3-a6bd-7f7d0cda1dd7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:29.758921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1dfd2-6a0d-4111-8d6d-dfe4d226c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:29.759094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dfd2-6a0d-4111-8d6d-dfe4d226c842 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.759278 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dfd2-6a0d-4111-8d6d-dfe4d226c842 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.759550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dfd2-6a0d-4111-8d6d-dfe4d226c842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.760777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dfd2-6a0d-4111-8d6d-dfe4d226c842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:29.762356 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dfd2-6a0d-4111-8d6d-dfe4d226c842 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:29.764166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 156/326] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:29.765452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7cc6-8eb7-4cf5-bdc9-b3eb16d20179 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.765764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7cc6-8eb7-4cf5-bdc9-b3eb16d20179 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.766003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d7cc6-8eb7-4cf5-bdc9-b3eb16d20179 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.767507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 157/327] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:29.771481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7cc6-8eb7-4cf5-bdc9-b3eb16d20179 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:29.806261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:29.807344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.807794 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.808246 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.809738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] RBAC: Adding query filter params (role.id=b248cf9aa90748efa3988f7d7548bc4a, user.id=1e47c20dea4f470c956600cc10f0317d, scope.system=all) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:29.810255 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:29.812763 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067950f5-ce4f-4d72-8444-7bedcb08594d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:29.834607 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 171/328] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jul 14 14:24:29 2022] GET /identity/v3/role_assignments?user.id=1e47c20dea4f470c956600cc10f0317d&scope.system=all&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:29.836830 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.837322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.837810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:29.866755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:29.868734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:29.932299 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d7cc6-8eb7-4cf5-bdc9-b3eb16d20179 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:29.956119 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:29.995370 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 172/329] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:29.997903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:29.998712 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:29.999166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:29.999569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] PATH_INFO: `/v3/groups` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.000447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:30.002325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:30.024193 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 158/330] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Jul 14 14:24:29 2022] POST /identity/v3/groups => generated 226 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:24:30.035609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:30.231639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66607d64-5b71-4779-8b2f-088aec5ab727 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:30.297640 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:30.298629 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:30.299147 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:30.299605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.319078 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:30.330088 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:30.333675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:30.336356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 173/331] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:30.339941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:30.415668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:30.524190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c8c16-0615-42d2-a3fc-514a6ef9317e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:30.571565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:30.572262 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:30.572546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:30.572824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.573621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:30.573933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:30.575486 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:30.588921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 159/332] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:30.594575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:30.652405 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:30.742765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cfff-8292-4793-a593-7d6c7d9f4cec None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:30.784339 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230b56-8055-44cc-b42a-9fb4d9386603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:30.785582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230b56-8055-44cc-b42a-9fb4d9386603 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:30.786025 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230b56-8055-44cc-b42a-9fb4d9386603 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:30.786466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230b56-8055-44cc-b42a-9fb4d9386603 None admin] PATH_INFO: `/v3/users/2edd27a09a7c496ca03924947ded606d` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.788049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230b56-8055-44cc-b42a-9fb4d9386603 None admin] RBAC: Authorizing `identity:get_user(user_id=2edd27a09a7c496ca03924947ded606d)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:30.789817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230b56-8055-44cc-b42a-9fb4d9386603 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:30.792075 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 174/333] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:30 2022] GET /identity/v3/users/2edd27a09a7c496ca03924947ded606d => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:30.798720 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:30.934633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec7579-d0af-4650-847c-1ca36fd2394d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:30.947928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:30.983791 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086b56-416f-4136-a471-d8db18a9d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:30.984956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086b56-416f-4136-a471-d8db18a9d483 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:30.985821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086b56-416f-4136-a471-d8db18a9d483 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:30.986284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086b56-416f-4136-a471-d8db18a9d483 None admin] PATH_INFO: `/v3/system/users/2edd27a09a7c496ca03924947ded606d/roles/9d5a697b555842e6ad223ef3d40cb9e0` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:30.989055 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086b56-416f-4136-a471-d8db18a9d483 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2edd27a09a7c496ca03924947ded606d, role_id=9d5a697b555842e6ad223ef3d40cb9e0)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:30.990685 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086b56-416f-4136-a471-d8db18a9d483 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:31.005951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 160/334] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Jul 14 14:24:30 2022] PUT /identity/v3/system/users/2edd27a09a7c496ca03924947ded606d/roles/9d5a697b555842e6ad223ef3d40cb9e0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:24:33.736680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb468026-2865-44c9-9feb-4e338063da4a None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:33.738184 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb468026-2865-44c9-9feb-4e338063da4a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:33.738184 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb468026-2865-44c9-9feb-4e338063da4a None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:33.740530 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 175/335] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:33.746689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1936-dfd5-4457-85d5-335f4cb99dd3 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:33.747615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1936-dfd5-4457-85d5-335f4cb99dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:33.747615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1936-dfd5-4457-85d5-335f4cb99dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:33.773374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-0a4a1936-dfd5-4457-85d5-335f4cb99dd3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:33.775011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-0a4a1936-dfd5-4457-85d5-335f4cb99dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:33.895887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 161/336] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:33.944117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb468026-2865-44c9-9feb-4e338063da4a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:34.083438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcd12c-4a1e-40a1-b88a-1b6dceb5bc95 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.083674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcd12c-4a1e-40a1-b88a-1b6dceb5bc95 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.084015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcd12c-4a1e-40a1-b88a-1b6dceb5bc95 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.085818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 162/337] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:34.090962 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb743ed-e0ce-4c59-8f36-3acaecc86361 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.091359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb743ed-e0ce-4c59-8f36-3acaecc86361 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.091594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb743ed-e0ce-4c59-8f36-3acaecc86361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.123508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-1fb743ed-e0ce-4c59-8f36-3acaecc86361 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:34.124853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-1fb743ed-e0ce-4c59-8f36-3acaecc86361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:34.161866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb468026-2865-44c9-9feb-4e338063da4a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:34.181486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:34.271313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:34.272149 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.272430 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.272712 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.280508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 163/338] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:34.282784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61dbe-701b-4810-b6a1-57fbd7cb0829 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.283109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61dbe-701b-4810-b6a1-57fbd7cb0829 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.283388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61dbe-701b-4810-b6a1-57fbd7cb0829 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.286419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 164/339] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:34.295560 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.295841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.296166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.308980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:34.318228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:34.320498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 176/340] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:34.322146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:34.341820 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:34.343016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:34.419374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:34.532815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 165/341] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:34.533447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:34.586568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5071c-d4f8-49df-b44a-164ac69c279e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:34.643045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:34.644910 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.645198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.645477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.672677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:34.694173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:34.695327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:34.696121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 177/342] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:34.696779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:34.760212 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:34.806315 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c295c3-8465-4525-af12-d95b32d24966 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:34.907833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975fe2a-5f5e-462c-8b9e-c76d292ee04f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:34.921470 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:34.922577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.923263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.923732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.926279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:34.926777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:34.929421 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:34.955530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 166/343] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:34.958721 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:34.965192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:34.966296 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:34.966920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:34.967401 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:34.986544 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:34.997092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:34.998052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:34.998917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:35.001947 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 178/344] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:35.004155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:35.027513 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:35.142396 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:35.164048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3f92-f17d-4a55-9045-ceed7621c5d4 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:35.215451 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:35.216760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:35.217197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:35.217616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:35.243440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d235b-557f-463a-bce6-2707546bce9c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:35.340546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:35.344006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:35.348244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:35.348957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:35.349251 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:35.349536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:35.350329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:35.350642 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:35.354308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:35.372704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 167/345] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:35.374750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:35.557327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:35.576808 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:35.592400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 179/346] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:35.594226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:35.597606 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5dd05-001b-4d83-a5bd-7210c4951595 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:35.638433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:35.639508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:35.639903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:35.640382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:35.641383 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:35.641775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:35.645086 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:35.656224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 168/347] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:35.657098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:35.782105 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461380-bc75-4d95-b342-4f40f0d654d1 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:35.803601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427a63-78c0-4029-9aa0-292db1ba28e9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:35.824571 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63dad8-7bbd-47ed-b7cb-79eb0036adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:35.825606 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63dad8-7bbd-47ed-b7cb-79eb0036adc1 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:35.825986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63dad8-7bbd-47ed-b7cb-79eb0036adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:35.826361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63dad8-7bbd-47ed-b7cb-79eb0036adc1 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:35.827791 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63dad8-7bbd-47ed-b7cb-79eb0036adc1 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:35.829511 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63dad8-7bbd-47ed-b7cb-79eb0036adc1 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:35.832711 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 169/348] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:35 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:35.834246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6352d8-b84a-4e52-9e20-1ad9306c24c7 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:35.834661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6352d8-b84a-4e52-9e20-1ad9306c24c7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:35.835095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6352d8-b84a-4e52-9e20-1ad9306c24c7 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:35.836661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 170/349] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:35.837459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6352d8-b84a-4e52-9e20-1ad9306c24c7 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:35.860346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:35.877661 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:35.880086 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:35.880826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:35.881515 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:35.981718 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6352d8-b84a-4e52-9e20-1ad9306c24c7 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:36.005203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.027290 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:36.030454 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:36.056337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a0fb-5a95-4d26-a1da-2c17fdb550e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:36.056951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a0fb-5a95-4d26-a1da-2c17fdb550e5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.057327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a0fb-5a95-4d26-a1da-2c17fdb550e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.057512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a0fb-5a95-4d26-a1da-2c17fdb550e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.170941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826a0fb-5a95-4d26-a1da-2c17fdb550e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:36.173179 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826a0fb-5a95-4d26-a1da-2c17fdb550e5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:36.206373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.233833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 180/350] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:36.235131 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:36.336854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 171/351] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:36.338640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c516d-c193-454a-abe9-a5ef42722522 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.339036 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c516d-c193-454a-abe9-a5ef42722522 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.339270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c516d-c193-454a-abe9-a5ef42722522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.361650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-9b9c516d-c193-454a-abe9-a5ef42722522 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:36.363682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-9b9c516d-c193-454a-abe9-a5ef42722522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:36.410260 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.441065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb3af-1b27-49da-ac0b-59f0d18226c0 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:36.497838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 172/352] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:36.498190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb93703-372f-49f4-a668-5c9f2a0aa8d2 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.498691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb93703-372f-49f4-a668-5c9f2a0aa8d2 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.499224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb93703-372f-49f4-a668-5c9f2a0aa8d2 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.501881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 173/353] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:36.504910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e09d0-dcdf-4f05-a905-101c466cecdd None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.505398 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e09d0-dcdf-4f05-a905-101c466cecdd None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.505853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e09d0-dcdf-4f05-a905-101c466cecdd None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.506371 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:36.507665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.508262 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.512532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 174/354] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:36.512532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e09d0-dcdf-4f05-a905-101c466cecdd None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:36.512792 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.524442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:36.526407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:36.528806 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 181/355] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:36 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:36.530246 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:36.619156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.712771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83f2b-3972-4a30-84a2-e0e92eff7afa None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:36.725914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e09d0-dcdf-4f05-a905-101c466cecdd None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:36.757788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1c7a5-db21-4e83-9cef-96a949ef8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:36.758668 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c7a5-db21-4e83-9cef-96a949ef8b0c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.758950 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c7a5-db21-4e83-9cef-96a949ef8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.759450 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c7a5-db21-4e83-9cef-96a949ef8b0c None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.762058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1c7a5-db21-4e83-9cef-96a949ef8b0c None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:36.763613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1c7a5-db21-4e83-9cef-96a949ef8b0c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:36.765451 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 182/356] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:36 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:36.766827 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.767211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.767656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.792388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:36.792672 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307b72-1572-41a1-a27d-fca2dc40cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:36.793557 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307b72-1572-41a1-a27d-fca2dc40cafa None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.793836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307b72-1572-41a1-a27d-fca2dc40cafa None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.793976 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:36.794191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307b72-1572-41a1-a27d-fca2dc40cafa None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.795532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f307b72-1572-41a1-a27d-fca2dc40cafa None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:36.797007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f307b72-1572-41a1-a27d-fca2dc40cafa None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:36.798819 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 175/357] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:36 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:36.800359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:36.800806 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:36.801218 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:36.818873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:36.833131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:36.835308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:36.916916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 183/358] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:36.919424 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:36.951307 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 176/359] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:36.953051 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.038313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:37.112732 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecced7-7328-4460-8636-3ce12ce116cd None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.141866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2557306-f93e-4752-8229-8d412a680a9d None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.187081 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.188344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.188767 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.189493 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.191400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:37.191916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:37.193759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:37.204122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 184/360] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:36 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:37.205335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.214812 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.215701 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.215987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.216265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.235272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:37.241842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:37.250736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:37.253043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 177/361] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:37.255145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.453049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29f78-e459-4d58-b5e8-1fa95607b14b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.467107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ee42-e2e6-4635-83c2-7450a2b4bb74 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.470902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:37.513067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.513955 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.514240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.514523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.515901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:37.517529 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:37.520852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 185/362] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:37.521704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.542867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.542867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.542867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.542867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.543992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:37.546793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:37.550846 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 178/363] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:37.552856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.668004 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:37.697372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8441-5e1c-4ebc-8a42-05f60456f4e9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.713621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af251b2-8429-4d53-a188-01d2e0875ff6 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.749392 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.750841 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.751360 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.751940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.758200 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.759290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.759641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.759995 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.771252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:37.775214 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:37.781256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:37.782225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:37.783067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:37.785474 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 186/364] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:37.786795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:37.796180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:37.797129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 179/365] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:37.797937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.850816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:37.920996 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6121ce-a1c3-47f6-9a4c-9190cfe636a0 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.938636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61e64-ab13-4a90-8922-7226151c9c8d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:37.963476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.964212 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.964445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.964724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.965501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:37.965808 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:37.968266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:37.979844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 187/366] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:37.980677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:37.990433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:37.994195 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:37.994913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:37.995239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:37.995653 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:37.996416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=415102e6bd7442b3b94057725e5ab261) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:37.996733 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:37.998215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.005152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 180/367] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:38.006391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:38.112117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826201-b472-45f8-aa00-895a71cecb88 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:38.172327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:38.173421 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:38.173951 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:38.175248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:38.176533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=415102e6bd7442b3b94057725e5ab261) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:38.177091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:38.179131 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.186802 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 188/368] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:37 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:38.188246 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:38.200035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:38.212479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15ed7-8ccf-4d59-97a8-38d7acddf9f9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:38.287578 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:38.289111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:38.289819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:38.291250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:38.293015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:38.295068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:38.295983 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:38.298941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.316966 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 181/369] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:38.319035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:38.344625 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eef9f-84ab-4337-9927-dcfe14df3d05 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:38.426359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:38.426359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:38.426359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:38.426359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:38.427827 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:38.428422 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:38.432114 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.452134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 189/370] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:38.453699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:38.476213 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70890b7-b24c-4798-9eba-17102a4796d7 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:38.516968 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:38.518310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:38.519779 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:38.520270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] PATH_INFO: `/v3/users/2edd27a09a7c496ca03924947ded606d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:38.521862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] RBAC: Authorizing `identity:get_user(user_id=2edd27a09a7c496ca03924947ded606d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:38.524140 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.526469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 182/371] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jul 14 14:24:38 2022] GET /identity/v3/users/2edd27a09a7c496ca03924947ded606d => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:38.527510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:38.575058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:38.689096 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a670-bbd0-4be2-b3dd-117995795d6e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:38.723800 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0e9cf-886c-4403-a87f-75c35c8da1ba None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:38.756744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:38.770596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:38.771948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:38.772461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:38.772944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:38.791938 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:38.793111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:38.793597 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:38.794088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:38.925800 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:38.927984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.932005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:38.934881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:38.989545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:39.064077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 190/372] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:39.065800 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.102508 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:39.140928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 183/373] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:39.142439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.192927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a5c0f-078d-4fa9-9bd0-6385e7023ff5 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:39.269618 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:39.270869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.271484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.272263 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.274046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] RBAC: Adding query filter params (role.id=9d5a697b555842e6ad223ef3d40cb9e0, user.id=2edd27a09a7c496ca03924947ded606d, scope.system=all) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:39.274735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:39.277546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:39.305027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 191/374] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/role_assignments?user.id=2edd27a09a7c496ca03924947ded606d&scope.system=all&role.id=9d5a697b555842e6ad223ef3d40cb9e0 => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:39.307018 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.396288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25511e9-1fc6-402d-aef2-b7152e3588cc None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:39.434349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:39.445824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:39.446660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.446949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.447285 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.448667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:39.450147 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:39.452521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 184/375] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:39.460088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.502096 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:39.533137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec2ae-6e1e-412d-88ff-e22b98598580 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:39.618772 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:39.620410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.620920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.621410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] PATH_INFO: `/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.629140 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] RBAC: Authorizing `identity:get_project(project_id=e1a3ee9626d64c6bbe126c49645c1edd)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:39.632195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:39.635725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 192/376] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd => generated 344 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:39.642311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.745088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daa95e-8948-4bb9-9c43-99885ceaceda None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:39.849355 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:39.851356 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.852270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.853120 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.860465 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:39.864949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:39.872650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 185/377] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:39.889607 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb69766-28df-42e5-95e5-d38ac3ab2b4f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:39.897471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:39.971823 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:39.972795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:39.974305 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:39.974305 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] PATH_INFO: `/v3/groups/9fb2c6e704a94ae2b7dd772ef197d8b9` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:39.991741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] RBAC: Authorizing `identity:get_group(group_id=9fb2c6e704a94ae2b7dd772ef197d8b9)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:39.994499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:40.006677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 193/378] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/groups/9fb2c6e704a94ae2b7dd772ef197d8b9 => generated 229 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:40.014751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:40.094610 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:40.099272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:40.240384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b636cb-9277-4622-baf1-7f26b7a890c9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:40.339526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288af8b-ea3c-454f-9356-73a5086f33a9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:40.370225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:40.371320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:40.371778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:40.372232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:40.373743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:40.374265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:40.381832 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcac85-c41b-4b5a-9b09-0086542c9cc3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:40.392604 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 186/379] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:39 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 260 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:40.434108 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:40.435181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:40.435616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:40.436044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:40.437495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] RBAC: Adding query filter params (group.id=9fb2c6e704a94ae2b7dd772ef197d8b9, role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=e1a3ee9626d64c6bbe126c49645c1edd) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:40.437980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:40.441140 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804fadd-e122-4da4-ba48-f4b35ed47678 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:40.456402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 194/380] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:40 2022] GET /identity/v3/role_assignments?group.id=9fb2c6e704a94ae2b7dd772ef197d8b9&scope.project.id=e1a3ee9626d64c6bbe126c49645c1edd&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 260 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:41.278684 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e9d0-71b8-4643-83e6-85244b013aca None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:41.279547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e9d0-71b8-4643-83e6-85244b013aca None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:41.279692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e9d0-71b8-4643-83e6-85244b013aca None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:41.282759 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 187/381] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:41.292168 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:41.293138 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:41.293138 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:41.333548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:41.335668 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:41.563442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 195/382] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 14:24:41.592172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e9d0-71b8-4643-83e6-85244b013aca None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:41.771842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e9d0-71b8-4643-83e6-85244b013aca None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:41.816350 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:41.829555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:41.830384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:41.831324 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:41.831637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:41.854550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:41.868271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:41.870477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:41.873343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 188/383] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:41.880382 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:41.933101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:42.180104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbb1c2-6287-4869-aeed-203be5b5b23a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:42.274961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:42.276160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:42.276664 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:42.277148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:42.278651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:42.279240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:42.281903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0126613-df31-4156-b57b-4214ad049cf0 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:42.307318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 196/384] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:42.312764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:42.500668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4832-51fd-41d1-a6e2-f1c0d1c21481 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:42.504756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bdc04-de60-4612-a023-103bc96eda30 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:42.505169 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bdc04-de60-4612-a023-103bc96eda30 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:42.505627 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bdc04-de60-4612-a023-103bc96eda30 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:42.508735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 197/385] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:42.515895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:42.516394 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:42.516869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:42.577658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:42.583445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:42.584968 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:42.585419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:42.585865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:42.587358 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:42.593814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:42.601501 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:42.610757 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 189/386] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:42 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:42.622938 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:42.759432 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:42.854895 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda1e5-8f5d-42ca-b74a-8cfa953f90b2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:42.902630 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 198/387] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:42.931825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:42.933224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:42.933726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:42.934210 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:42.935856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:42.937550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:42.940624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 190/388] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:42 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:42.947280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:42.958877 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:42.962035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:43.092024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7446fe-7b37-41f4-b688-e7ce669cda7f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:43.123668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:43.135374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d297f6-0c77-4fb0-9003-4459291c16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:43.136278 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d297f6-0c77-4fb0-9003-4459291c16c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:43.136553 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d297f6-0c77-4fb0-9003-4459291c16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:43.136833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d297f6-0c77-4fb0-9003-4459291c16c4 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:43.137567 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae236-2be2-44b5-9533-b9a6ea930b8d None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:43.138953 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d297f6-0c77-4fb0-9003-4459291c16c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=916ca130ed7f4f009c1917a7f0e7c907, group_id=80b435ce6e844509ad6e6caf5366e1c8, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:43.140435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d297f6-0c77-4fb0-9003-4459291c16c4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:43.171014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 191/389] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jul 14 14:24:42 2022] PUT /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:43.171014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bc623-25de-456a-86b3-a694f8e200bb None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:43.171014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bc623-25de-456a-86b3-a694f8e200bb None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:43.171014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bc623-25de-456a-86b3-a694f8e200bb None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:43.171014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 192/390] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:43.183659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:43.184061 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:43.184239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:43.217145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:43.220625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:43.242455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:43.243327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:43.243626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:43.243882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:43.279925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:43.289484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:43.291555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:43.294042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:43.298623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 199/391] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:43.300853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:43.403602 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 193/392] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:43.421418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:43.490628 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:43.551040 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5c26e-2999-403d-8c6e-2b0cd12c9038 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:43.601450 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:43.602564 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:43.603066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:43.603421 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:43.604402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:43.604749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:43.607361 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:43.615537 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bf943-125e-4702-a3e9-c0b47ff6bf53 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:43.627067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 200/393] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:43.637525 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:43.650688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:43.711974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:43.713184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:43.713682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:43.714175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:43.759700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:43.791919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:43.792879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:43.793866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:43.805543 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 194/394] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:43.823869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:43.941041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee6a4-3a87-4690-abc4-df63084d13dc None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:43.996066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:44.005689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:44.006566 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.007372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.007372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.008432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:44.009942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:44.012166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 201/395] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:43 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:44.023675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:44.152097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654a26-a503-482a-9257-6f9b9b5127c2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:44.186229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6661a-7952-4ef4-b51c-824ef367a247 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:44.196747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52e6ad-e2ca-49db-8781-dbfc9ac391c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:44.197627 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e6ad-e2ca-49db-8781-dbfc9ac391c1 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.197909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e6ad-e2ca-49db-8781-dbfc9ac391c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.198181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e6ad-e2ca-49db-8781-dbfc9ac391c1 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.199514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52e6ad-e2ca-49db-8781-dbfc9ac391c1 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:44.201006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52e6ad-e2ca-49db-8781-dbfc9ac391c1 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:44.203179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 202/396] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:44 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:44.213610 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6e965-cf18-49d6-ba00-4757a96c31a3 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.213959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6e965-cf18-49d6-ba00-4757a96c31a3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.214169 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6e965-cf18-49d6-ba00-4757a96c31a3 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.219895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 203/397] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:44.222550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.222834 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.223527 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.243504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:44.245105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:44.269812 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:44.270953 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.271442 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.271896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.273351 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:44.273995 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:44.276708 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:44.294828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 195/398] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:44.296249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:44.336433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:44.348083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 204/399] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:44.356130 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:44.362609 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:44.478073 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261743-7f71-4a15-9ad3-e0f8d6b96545 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:44.546692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d28feb-e3de-4e2f-aec6-50a7a38d3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:44.547520 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d28feb-e3de-4e2f-aec6-50a7a38d3e06 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.547807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d28feb-e3de-4e2f-aec6-50a7a38d3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.548088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d28feb-e3de-4e2f-aec6-50a7a38d3e06 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/7ec579bc6ca745cea09c4d5f57d4663d` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.551766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d28feb-e3de-4e2f-aec6-50a7a38d3e06 None admin] RBAC: Authorizing `identity:create_grant(project_id=415102e6bd7442b3b94057725e5ab261, group_id=80b435ce6e844509ad6e6caf5366e1c8, role_id=7ec579bc6ca745cea09c4d5f57d4663d)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:44.554479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d28feb-e3de-4e2f-aec6-50a7a38d3e06 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:44.561933 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c041b2-55a7-4544-b205-80ad205343ee None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:44.573105 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 196/400] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jul 14 14:24:44 2022] PUT /identity/v3/projects/415102e6bd7442b3b94057725e5ab261/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/7ec579bc6ca745cea09c4d5f57d4663d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:44.575684 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbea73-d265-4444-b062-1027f2dd9420 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.576171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbea73-d265-4444-b062-1027f2dd9420 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.576584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbea73-d265-4444-b062-1027f2dd9420 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.578302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 197/401] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:44.579372 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbea73-d265-4444-b062-1027f2dd9420 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:44.644394 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f482c-6ddd-4588-9794-b9cb8133e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:44.645866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f482c-6ddd-4588-9794-b9cb8133e91e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.646345 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f482c-6ddd-4588-9794-b9cb8133e91e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.646813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f482c-6ddd-4588-9794-b9cb8133e91e None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.649510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f482c-6ddd-4588-9794-b9cb8133e91e None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:44.652323 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f482c-6ddd-4588-9794-b9cb8133e91e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:44.655995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 205/402] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:44 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:44.658492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.659041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.659511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.691186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:44.693633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:44.795433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:44.813626 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbea73-d265-4444-b062-1027f2dd9420 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:44.826541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:44.842373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 206/403] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:44.843662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:44.891738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:44.893361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:44.893361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:44.893361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:44.914489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:44.922756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:44.930579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 198/404] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:44.932176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:45.013621 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75b3ad-4d1a-4e6d-b354-0de8efb40877 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.063840 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.065730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.066209 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.066681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.069204 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:45.072507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:45.084065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 207/405] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:44 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:45.085812 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:45.099190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4cc3-db45-4a30-9ad1-c345125eecbc None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.147483 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.149746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.150267 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.150747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.174791 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:45.181631 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:45.202666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:45.204389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:45.206469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:45.211710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 199/406] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:45.213855 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:45.247198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0084f-75a7-41b9-890f-c2b598c4365f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.260161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:45.308164 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.309607 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.310108 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.310608 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.311731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:45.312270 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:45.314226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:45.326944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 208/407] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:45.328188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:45.421049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41bb06-2451-4fe9-809b-11b41ed79ffe None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.501635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.503967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.504674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.505261 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.509092 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=415102e6bd7442b3b94057725e5ab261, group_id=80b435ce6e844509ad6e6caf5366e1c8, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:45.512019 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:45.517650 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b0c57-d72e-42fa-9d99-365b6be5ec24 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.543047 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 200/408] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jul 14 14:24:45 2022] PUT /identity/v3/projects/415102e6bd7442b3b94057725e5ab261/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:45.543047 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:45.624804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:45.681284 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.681986 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.682273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.682550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.683361 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:45.683669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:45.685102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:45.691984 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:45.717152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 209/409] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:45.724091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:45.741365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d3792-a7bb-4e93-87f3-0663ba073d8f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:45.808816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:45.810252 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:45.810730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:45.811297 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] PATH_INFO: `/v3/groups/9fb2c6e704a94ae2b7dd772ef197d8b9` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:45.813556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] RBAC: Authorizing `identity:get_group(group_id=9fb2c6e704a94ae2b7dd772ef197d8b9)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:45.817085 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:45.823059 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 201/410] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:45 2022] GET /identity/v3/groups/9fb2c6e704a94ae2b7dd772ef197d8b9 => generated 229 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:45.825838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:46.024193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b088-0eff-4dc0-8ef5-22e1e6a15021 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:46.028482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fb5a-aff1-4cb9-9757-647ac04fdbd6 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:46.075380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:46.076867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.077377 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.077899 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] PATH_INFO: `/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.079500 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a3ee9626d64c6bbe126c49645c1edd)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:46.082739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:46.085687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 202/411] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:45 2022] GET /identity/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:46.092075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:46.093229 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:46.094157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.094444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.094728 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.099762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:46.101747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:46.105228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 210/412] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:45 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:46.113235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:46.125925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:46.207401 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:46.301699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fec18c-fdca-4a8f-855b-288e1c5ee008 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:46.319716 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ecf72-84ad-443f-8435-6170de03c182 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:46.360666 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ed1e7-7e96-4a2a-9a88-b9831e2585cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:46.362318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed1e7-7e96-4a2a-9a88-b9831e2585cd None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.363592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed1e7-7e96-4a2a-9a88-b9831e2585cd None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.364027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed1e7-7e96-4a2a-9a88-b9831e2585cd None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.367731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ed1e7-7e96-4a2a-9a88-b9831e2585cd None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:46.370534 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ed1e7-7e96-4a2a-9a88-b9831e2585cd None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:46.374380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 211/413] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:46 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:46.376985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6e1c8-8122-442c-ba27-d814f977329b None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.378160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6e1c8-8122-442c-ba27-d814f977329b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.378521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6e1c8-8122-442c-ba27-d814f977329b None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.385584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 212/414] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:46.385584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6e1c8-8122-442c-ba27-d814f977329b None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:46.386645 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab28fa-094f-417c-853f-1bdb895d4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:46.387840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab28fa-094f-417c-853f-1bdb895d4301 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.388373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab28fa-094f-417c-853f-1bdb895d4301 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.388857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab28fa-094f-417c-853f-1bdb895d4301 None admin] PATH_INFO: `/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd/groups/9fb2c6e704a94ae2b7dd772ef197d8b9/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.393760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab28fa-094f-417c-853f-1bdb895d4301 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1a3ee9626d64c6bbe126c49645c1edd, group_id=9fb2c6e704a94ae2b7dd772ef197d8b9, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:46.395673 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab28fa-094f-417c-853f-1bdb895d4301 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:46.414895 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 203/415] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jul 14 14:24:46 2022] PUT /identity/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd/groups/9fb2c6e704a94ae2b7dd772ef197d8b9/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:46.417039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.417569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.418053 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.446757 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:46.448544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:46.545385 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:46.560294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 204/416] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:46.622763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:46.728622 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6e1c8-8122-442c-ba27-d814f977329b None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:46.805891 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbcb50-f4a3-49d2-993c-02f7cc7dde89 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:46.808776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:46.853703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:46.854879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.855346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.855876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.868412 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:46.870069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:46.870422 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:46.870576 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:46.873077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/7ec579bc6ca745cea09c4d5f57d4663d` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:46.880001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:46.881041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:46.881965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:46.882573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] RBAC: Authorizing `identity:create_grant(project_id=916ca130ed7f4f009c1917a7f0e7c907, group_id=80b435ce6e844509ad6e6caf5366e1c8, role_id=7ec579bc6ca745cea09c4d5f57d4663d)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:46.884327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:46.884451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 205/417] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:46.892680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:46.923640 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 213/418] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jul 14 14:24:46 2022] PUT /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907/groups/80b435ce6e844509ad6e6caf5366e1c8/roles/7ec579bc6ca745cea09c4d5f57d4663d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:24:46.993849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:47.050826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b9a06-b369-4927-ac3e-631feb5ed7e5 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:47.100628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:47.101340 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:47.101632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:47.101908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:47.102787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:47.103110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:47.104579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:47.119915 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 206/419] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:47.125585 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:47.353386 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a83424-43d6-44ac-b8df-557307375f5f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:47.446654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e5c0f-dbc3-4e07-8d5b-62fa598663ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:47.447717 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e5c0f-dbc3-4e07-8d5b-62fa598663ec None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:47.448237 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e5c0f-dbc3-4e07-8d5b-62fa598663ec None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:47.448732 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e5c0f-dbc3-4e07-8d5b-62fa598663ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:47.535406 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:47.563229 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e5c0f-dbc3-4e07-8d5b-62fa598663ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:47.565805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e5c0f-dbc3-4e07-8d5b-62fa598663ec None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:47.730964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 214/420] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:47.738880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:47.775381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02207-55ac-41fd-9033-3ae15b5ed81e None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:47.776372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02207-55ac-41fd-9033-3ae15b5ed81e None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:47.777153 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02207-55ac-41fd-9033-3ae15b5ed81e None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:47.780671 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 215/421] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:47.787797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:47.788747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:47.789504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:47.836872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:47.838997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:48.061353 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 216/422] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:48.082459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeca92-daae-42c0-8431-abbf009b4bed None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:48.092750 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:48.113021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:48.127910 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:48.165190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:48.166710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:48.168123 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:48.168639 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:48.171740 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:48.174588 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:48.178075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 207/423] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:47 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:48.191399 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:48.388616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7981-5c54-49b7-86a4-cc35e1d96538 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:48.474830 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:48.476066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:48.476573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:48.477051 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:48.498674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5f44-fe10-4e87-ac68-d59370374503 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:48.506764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:48.515634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:48.516596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:48.517373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:48.535323 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 217/424] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:48.538679 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:48.590735 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:48.592054 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:48.592777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:48.594043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:48.597706 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:48.599849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:48.603826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 208/425] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:48 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:48.615507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:48.667703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:48.719667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499acc5-7600-4c59-bf27-551f88f6a633 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:48.817885 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:48.837526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:48.838679 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:48.839207 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:48.839689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:48.841159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:48.843513 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:48.847787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:48.875754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 218/426] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:48.888573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:48.909391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f9f25-15b9-49bb-bfb2-5d8c737be42f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:48.948508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:48.949204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:48.949475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:48.949762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:48.950607 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:48.950919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:48.952437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110fba5-d607-4a43-b5a1-db4513530265 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:48.960612 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 209/427] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:48 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 611 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:48.991674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecdf19-26ea-4fad-b2c4-dc9c31ddad09 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:48.992096 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecdf19-26ea-4fad-b2c4-dc9c31ddad09 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:48.992247 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecdf19-26ea-4fad-b2c4-dc9c31ddad09 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:48.994742 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 210/428] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:49.010274 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.010555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.010859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.071363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:49.077989 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:49.180149 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca4307-2749-4419-bc57-980788929c1c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:49.249781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:49.256651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:49.257329 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.257615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.257897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.297603 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 211/429] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:49.327914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:49.380885 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:49.382412 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:49.463139 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:49.561579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c568b54-1d6d-4a37-bebc-4b8410ff7f3b None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:49.575595 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 219/430] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:24:49.581760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:49.628726 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:49.650903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:49.653506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.654108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.654685 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.673038 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:49.682014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:49.683240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 14:24:49.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:49.687594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 212/431] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:49.699014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:49.729339 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08b06-13de-4589-811d-2bab76354f03 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:49.809144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:49.810581 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.811071 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.811643 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.814022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:49.817604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:49.821783 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 220/432] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:49 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:49.827162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:49.918249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7465e-e74d-41cb-a085-e2dafab43f4c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:49.940077 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:49.969438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:49.970510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:49.971670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:49.972149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:49.973152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] RBAC: Adding query filter params (name=member) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:49.973695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:49.975677 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:49.986966 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 213/433] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:49.997964 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:50.015266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:50.022510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbffa6-caea-4d8f-9a0f-f4ff8bb9c55a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:50.070444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:50.071935 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.072510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.072980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.074906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:50.077111 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:50.079658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 221/434] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:49 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:50.087050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:50.160507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e3fe-81f0-43f8-a10e-ad9e2be5fe0f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:50.202053 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a9264-5641-4b30-ad04-6af86bb71363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:50.202730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a9264-5641-4b30-ad04-6af86bb71363 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.203116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a9264-5641-4b30-ad04-6af86bb71363 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.203399 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a9264-5641-4b30-ad04-6af86bb71363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.279153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:50.288335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe3c32-2649-4378-93f8-08beef0297dd None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:50.328400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a9264-5641-4b30-ad04-6af86bb71363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:50.330787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a9264-5641-4b30-ad04-6af86bb71363 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:50.331433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:50.332366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.332709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.333022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.333991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=415102e6bd7442b3b94057725e5ab261) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:50.334461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:50.336097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b24ff7-aab7-4689-9746-2e13a6b1d1e7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:50.343040 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 222/435] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:50 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 611 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:50.444124 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eccbb6-c7b3-4b78-b871-fd897b854050 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.444485 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eccbb6-c7b3-4b78-b871-fd897b854050 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.444700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eccbb6-c7b3-4b78-b871-fd897b854050 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.446494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 223/436] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:50.452372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240bcb-812f-4e01-8dad-6a7ef8ca2aee None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.452673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240bcb-812f-4e01-8dad-6a7ef8ca2aee None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.452934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240bcb-812f-4e01-8dad-6a7ef8ca2aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.473314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5b240bcb-812f-4e01-8dad-6a7ef8ca2aee None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:50.474848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5b240bcb-812f-4e01-8dad-6a7ef8ca2aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:50.508362 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:50.517092 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 214/437] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:24:50.519616 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b711c5-646d-476b-85dd-1554416a11d1 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.520244 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b711c5-646d-476b-85dd-1554416a11d1 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.520732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b711c5-646d-476b-85dd-1554416a11d1 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.522442 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 215/438] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:50.528317 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b711c5-646d-476b-85dd-1554416a11d1 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:50.570726 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 224/439] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:50.571611 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345c808-dae8-412d-9228-248ab517f435 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.571904 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345c808-dae8-412d-9228-248ab517f435 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.572186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345c808-dae8-412d-9228-248ab517f435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.596441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-d345c808-dae8-412d-9228-248ab517f435 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:50.598823 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-d345c808-dae8-412d-9228-248ab517f435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:50.656477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:50.709826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 225/440] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:50.710776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345c808-dae8-412d-9228-248ab517f435 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:50.713673 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b711c5-646d-476b-85dd-1554416a11d1 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:50.780518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:50.781394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.781679 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.781980 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] PATH_INFO: `/v3/projects/415102e6bd7442b3b94057725e5ab261` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.783933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] RBAC: Authorizing `identity:get_project(project_id=415102e6bd7442b3b94057725e5ab261)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:50.785656 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:50.787480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 216/441] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:50 2022] GET /identity/v3/projects/415102e6bd7442b3b94057725e5ab261 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:50.788284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:50.841013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:50.851813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345c808-dae8-412d-9228-248ab517f435 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:50.892426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:50.893256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.893633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.894030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:50.906403 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:50.916066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:50.917901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 226/442] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:50.919334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:50.949490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f712ba-ec2e-49f2-b7ab-7048ffc15b67 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:50.998463 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:50.999337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:50.999619 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:50.999893 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.015661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:51.025622 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:51.027468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 217/443] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:51.029037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:51.034872 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:51.044889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea002-954a-4d01-8c3b-5eb890bda365 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:51.083594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:51.084444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:51.084727 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:51.085007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.086219 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:51.087876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:51.089533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 227/444] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:50 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:51.090304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:51.115679 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:51.141858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29ecf-60ce-4ef0-9510-06797161dabf None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:51.185512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:51.186638 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:51.187335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:51.187849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.189930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:51.190483 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:51.193090 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:51.208726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 218/445] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:24:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:51.210075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:51.225851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5808a-6925-42e1-aa3a-1f6f14907fe7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:51.273722 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:51.274897 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:51.275280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:51.275692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.276757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:51.277216 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:51.278932 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:51.290699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 228/446] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:51.291954 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:51.297416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:51.348505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a928e-8eec-449e-90a7-390cfc0568cc None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:51.393654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:51.399092 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:51.399763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:51.400043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:51.400321 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.401163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=b248cf9aa90748efa3988f7d7548bc4a, scope.project.id=415102e6bd7442b3b94057725e5ab261) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:51.401470 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:51.402923 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:51.410020 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 219/447] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:51 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=415102e6bd7442b3b94057725e5ab261&role.id=b248cf9aa90748efa3988f7d7548bc4a => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:51.411491 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:51.422869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156ec0-ada7-4231-b044-36a20e26b5e2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:51.479708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:51.480603 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:51.481047 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:51.481514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.604976 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc218b-b623-41b9-a4eb-ff3c97fd16ed None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:51.621765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:51.625101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:51.653255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:51.670562 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:51.671294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:51.671585 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:51.671873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:51.790223 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:51.795591 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:51.834110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:51.883199 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 229/448] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:51.892715 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.039013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 220/449] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:24:52.043615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.100240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:52.105287 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b216c-f390-43fa-a239-721a0d18e69e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.180044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.181570 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.182011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.182506 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] PATH_INFO: `/v3/projects/916ca130ed7f4f009c1917a7f0e7c907` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.184661 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] RBAC: Authorizing `identity:get_project(project_id=916ca130ed7f4f009c1917a7f0e7c907)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.187287 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.190061 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 230/450] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:51 2022] GET /identity/v3/projects/916ca130ed7f4f009c1917a7f0e7c907 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:52.196433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.221845 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f093a92-e195-4069-8efb-0574b003ebf8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.269759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:52.282322 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.283632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.283819 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.284227 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] PATH_INFO: `/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.285790 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] RBAC: Authorizing `identity:get_project(project_id=e1a3ee9626d64c6bbe126c49645c1edd)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.288001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.290216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 221/451] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jul 14 14:24:52 2022] GET /identity/v3/projects/e1a3ee9626d64c6bbe126c49645c1edd => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:52.296132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.355233 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf76b-3d55-4bcb-ab69-a3a51f7d2110 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.414046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.415836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.416339 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.416813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] PATH_INFO: `/v3/groups/80b435ce6e844509ad6e6caf5366e1c8` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.419098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] RBAC: Authorizing `identity:get_group(group_id=80b435ce6e844509ad6e6caf5366e1c8)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.421697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.426314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 231/452] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:52 2022] GET /identity/v3/groups/80b435ce6e844509ad6e6caf5366e1c8 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:52.431077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.432171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:52.442053 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf79dc-cd07-4194-b44a-22d41746e6af None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.487249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.488574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.488863 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.489144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] PATH_INFO: `/v3/groups/9fb2c6e704a94ae2b7dd772ef197d8b9` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.490490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] RBAC: Authorizing `identity:get_group(group_id=9fb2c6e704a94ae2b7dd772ef197d8b9)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.492007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.493728 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 222/453] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jul 14 14:24:52 2022] GET /identity/v3/groups/9fb2c6e704a94ae2b7dd772ef197d8b9 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:52.499936 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:52.557015 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fafec5-d6a2-4312-bb91-a84e88588446 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.577372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:52.596621 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.597280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.597552 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.597835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.598656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] RBAC: Adding query filter params (group.id=80b435ce6e844509ad6e6caf5366e1c8, role.id=7ec579bc6ca745cea09c4d5f57d4663d, scope.project.id=916ca130ed7f4f009c1917a7f0e7c907) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:52.598968 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.600507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ed579-bf82-4a0f-90dd-cf58a856b145 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.606916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 232/454] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:52 2022] GET /identity/v3/role_assignments?group.id=80b435ce6e844509ad6e6caf5366e1c8&scope.project.id=916ca130ed7f4f009c1917a7f0e7c907&role.id=7ec579bc6ca745cea09c4d5f57d4663d => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:52.637048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d49eb1-8797-4e98-8bce-75f69e2b8f4f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:52.682029 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:52.682711 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:52.683030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:52.683300 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:52.684164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] RBAC: Adding query filter params (group.id=9fb2c6e704a94ae2b7dd772ef197d8b9, role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=e1a3ee9626d64c6bbe126c49645c1edd) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:52.684469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:52.685967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0500237-540e-40e4-b982-1e90779acaf5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:52.693844 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 223/455] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jul 14 14:24:52 2022] GET /identity/v3/role_assignments?group.id=9fb2c6e704a94ae2b7dd772ef197d8b9&scope.project.id=e1a3ee9626d64c6bbe126c49645c1edd&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:55.545019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfc41-b3b2-4516-af22-4c3d9bf32c81 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:55.546014 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfc41-b3b2-4516-af22-4c3d9bf32c81 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:55.546579 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfc41-b3b2-4516-af22-4c3d9bf32c81 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:55.548773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 233/456] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:55.555146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2783a9d-33a2-4204-89b8-c17e1b1dab5c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:55.556213 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2783a9d-33a2-4204-89b8-c17e1b1dab5c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:55.556706 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2783a9d-33a2-4204-89b8-c17e1b1dab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:55.577408 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f2783a9d-33a2-4204-89b8-c17e1b1dab5c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:55.579452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f2783a9d-33a2-4204-89b8-c17e1b1dab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:55.615333 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:55.671038 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 224/457] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:55.698235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfc41-b3b2-4516-af22-4c3d9bf32c81 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:55.825240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfc41-b3b2-4516-af22-4c3d9bf32c81 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:55.858030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bddb-a0db-47fe-bc77-a729476f33c4 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:55.858691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bddb-a0db-47fe-bc77-a729476f33c4 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:55.859221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bddb-a0db-47fe-bc77-a729476f33c4 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:55.861879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 225/458] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:24:55.867935 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:55.868552 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:55.869049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:55.870846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:55.871721 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:55.872002 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:55.872276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:55.884809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:55.886268 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:55.889286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:55.890818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:24:55.906871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:55.908429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:55.909669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:24:55.909669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:24:55.909669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:55.909669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:55.909669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 234/459] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:55.915659 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:55.957013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:55.991308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 226/460] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:56.012479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:56.040149 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306082-7e36-492c-b11e-f8f978894802 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:56.078330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:56.078910 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.079355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.079637 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.081240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:56.081633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:56.083089 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:56.104080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 235/461] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:56.109690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:56.123464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:56.138690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1da3e8-62dd-4fe3-aa63-280b7fae2058 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:56.185234 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:56.186449 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.186940 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.187538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.201478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:56.203498 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:56.221816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:56.229385 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf524a-bdc8-49ef-b640-7c4928e25be7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:24:56.229902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:56.230943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:56.231829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:24:56.231829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:24:56.231829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:56.231829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:24:56.239284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 227/462] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:24:56.241264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:56.272883 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc3674-d13f-4d79-a049-8b5bad00c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:56.273568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3674-d13f-4d79-a049-8b5bad00c820 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.273848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3674-d13f-4d79-a049-8b5bad00c820 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.274122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3674-d13f-4d79-a049-8b5bad00c820 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.274935 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc3674-d13f-4d79-a049-8b5bad00c820 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:56.276682 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc3674-d13f-4d79-a049-8b5bad00c820 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:56.302486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 236/463] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:56 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:24:56.303972 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd250-deec-4c26-888c-33c31bae55c8 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.304266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd250-deec-4c26-888c-33c31bae55c8 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.304538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd250-deec-4c26-888c-33c31bae55c8 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.306291 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 237/464] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:56.314730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.315192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.315736 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.346561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:56.347901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:56.374684 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b3b4-f81d-41ca-98f8-402df4383be8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:56.431797 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:56.432903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.433434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.433955 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.436014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:56.436577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:56.439838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:56.475453 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:56.482088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 228/465] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:56.484822 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:56.491365 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 238/466] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:56.542818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:56.646381 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da350d4c-e824-4306-95a2-f4780036ed6e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:56.665927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:56.712511 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c92e-bd56-428c-800d-53a08c160b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:56.713487 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c92e-bd56-428c-800d-53a08c160b46 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.713937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c92e-bd56-428c-800d-53a08c160b46 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.714359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c92e-bd56-428c-800d-53a08c160b46 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.715305 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7a46c-1e5b-446d-8755-40dd2e6800e4 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:56.715530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633c92e-bd56-428c-800d-53a08c160b46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:56.717193 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633c92e-bd56-428c-800d-53a08c160b46 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:56.742057 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 229/467] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:56 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:56.744160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a5a5-7703-4680-a57a-bc265dc697a1 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.744652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a5a5-7703-4680-a57a-bc265dc697a1 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.745079 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a5a5-7703-4680-a57a-bc265dc697a1 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.746741 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 230/468] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:56.764810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.765093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.765563 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.786584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:56.788451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:56.812614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:56.814389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:56.815196 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:56.815923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:56.840002 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:56.843497 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:56.857266 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:24:56.890171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:56.892044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:56.894522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:24:56.894522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:24:56.894522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:56.894522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:56.895177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 231/469] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:24:56.903326 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 239/470] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:56.908572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:56.916468 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:57.059590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee4ae6-7280-4d92-8fd4-3401280de519 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:57.109804 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:57.111873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:57.111873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:57.112861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.114717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:57.115420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:57.118496 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:57.129851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ee45-9c36-437f-8a37-86eabe1a19ed None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:57.146324 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 232/471] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:24:57.151818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:57.207349 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:57.219773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:57.222719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:57.223352 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:57.223872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.240333 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:57.255845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:57.259864 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:24:57.304279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:57.306183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:57.307886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:24:57.307886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:24:57.307886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:24:57.307886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:57.307886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 240/472] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:24:57.317660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:57.344040 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a9f13-c37e-45a1-8535-25d4c315d591 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:57.415788 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:57.417310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:57.418075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:57.418683 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.420304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:57.423097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:57.457798 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5a94-31e8-46b0-8c62-7418b940e389 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:57.466534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 233/473] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:57 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:57.509627 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:57.510654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:57.511127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:57.511548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.512497 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:24:57.512962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:57.514563 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0f30d-f784-4a35-ac4c-66ac2aca5975 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:57.530313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 241/474] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:24:57.543208 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:57.749867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2bac5-a973-49cb-8a1d-9e41bea0389e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:57.752469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:57.822863 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489cf0-05c7-49ad-8a5d-4ed9dc03ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:57.824623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489cf0-05c7-49ad-8a5d-4ed9dc03ed96 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:57.825283 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489cf0-05c7-49ad-8a5d-4ed9dc03ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:57.825969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489cf0-05c7-49ad-8a5d-4ed9dc03ed96 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:57.827700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489cf0-05c7-49ad-8a5d-4ed9dc03ed96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:24:57.831661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489cf0-05c7-49ad-8a5d-4ed9dc03ed96 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:24:57.871145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 234/475] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:24:57 2022] POST /identity/v3/users => generated 249 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:24:59.543428 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d499f2-d735-41a2-9f78-692ef8237e72 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:59.544218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d499f2-d735-41a2-9f78-692ef8237e72 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:59.544526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d499f2-d735-41a2-9f78-692ef8237e72 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:59.546353 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 242/476] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:24:59.553366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:59.555572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:59.556503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:59.600981 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:24:59.607569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:24:59.772510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 235/477] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:24:59.800062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d499f2-d735-41a2-9f78-692ef8237e72 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:24:59.857413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:59.932463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d499f2-d735-41a2-9f78-692ef8237e72 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:24:59.973418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08cfc8-9a87-4c3c-9bbf-2c8122f0106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:24:59.974343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08cfc8-9a87-4c3c-9bbf-2c8122f0106d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:24:59.974791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08cfc8-9a87-4c3c-9bbf-2c8122f0106d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:24:59.975122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08cfc8-9a87-4c3c-9bbf-2c8122f0106d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:24:59.989027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08cfc8-9a87-4c3c-9bbf-2c8122f0106d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-9f08cfc8-9a87-4c3c-9bbf-2c8122f0106d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:24:59.997789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:24:59.998760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:24:59.999601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 243/478] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:24:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:00.005873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.040469 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010b2-ba2c-45ad-9353-3f2deed560d4 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.040809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010b2-ba2c-45ad-9353-3f2deed560d4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.041259 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010b2-ba2c-45ad-9353-3f2deed560d4 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.042947 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 244/479] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:00.051118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.051489 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.051941 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.083854 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:00.085998 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:00.151724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:00.173373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6e27-9c9e-48d3-9710-e73c9e75c3f6 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.183170 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 245/480] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:25:00.204017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.231392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.232392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.232677 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.232957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.234049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:00.234388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:00.236968 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:00.246451 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:00.260369 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 236/481] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:00.266134 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.352736 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d416-be42-4179-b6d3-b12a150fd375 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.401710 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.402677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.402965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.403277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.415143 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f82b8b-fcd4-49ba-8660-b2b7f12d8133 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.417319 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:00.427052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:00.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:00.428929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 246/482] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:00.437331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.460616 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.461844 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.462786 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.463729 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.479765 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:00.481668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:00.502704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:00.503823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:00.504686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:00.504686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:00.504686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:00.504686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:00.507148 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 237/483] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:00.515471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.519820 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:00.571369 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:00.581460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79fcc-961f-40a5-a09a-ce44b2b3be61 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.645915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.647916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.648916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.649418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.650887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:00.652184 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:00.654690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:00.663436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b66c4-05cb-40db-a466-d70f18fec48a None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.670100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 247/484] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:00.682937 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.719048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.720176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.721374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.721763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.722446 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:00.722828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:00.725560 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0126b3-1bb1-4217-b7e9-9e8faf4ad32f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:00.745822 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 238/485] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:00.747154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b6bd3-1b44-4a32-905e-c6273fab3df7 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.747441 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b6bd3-1b44-4a32-905e-c6273fab3df7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.747724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b6bd3-1b44-4a32-905e-c6273fab3df7 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.755162 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 239/486] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:00.755162 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b6bd3-1b44-4a32-905e-c6273fab3df7 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:00.818304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4325-0056-4c23-a0f2-9794feb6d971 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.848708 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:00.867749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.868667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.868991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.869341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.886841 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:00.888601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:00.907450 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b6bd3-1b44-4a32-905e-c6273fab3df7 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-1bfe4ec9-89c4-4c75-8e43-380f73821303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:00.915159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:00.916195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:00.917043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:00.917043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:00.917043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:00.917043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:00.917256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 248/487] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:00.919369 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.919873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.920295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.948378 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:00.950349 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:00.953729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:00.970287 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941a162-4124-4dee-a188-4977119946be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:00.971655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a162-4124-4dee-a188-4977119946be None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:00.972032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a162-4124-4dee-a188-4977119946be None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:00.972503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941a162-4124-4dee-a188-4977119946be None admin] PATH_INFO: `/v3/users/nova` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:00.982211 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941a162-4124-4dee-a188-4977119946be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:00.983977 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941a162-4124-4dee-a188-4977119946be None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-6941a162-4124-4dee-a188-4977119946be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:01.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:01.005763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 240/488] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jul 14 14:25:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b03e-bdd0-4563-a3c1-3375a8a79160 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.007569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b03e-bdd0-4563-a3c1-3375a8a79160 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.008867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b03e-bdd0-4563-a3c1-3375a8a79160 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.009321 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 241/489] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:01.011147 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b03e-bdd0-4563-a3c1-3375a8a79160 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:01.076220 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 249/490] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:01.077953 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:01.183117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b03e-bdd0-4563-a3c1-3375a8a79160 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:01.225039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:01.242031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b513-9d17-4835-b9d5-b8531638669f None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:01.242310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:01.243162 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.243562 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.243996 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.244928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:01.245365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:01.246919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962808e-c2c6-4b64-a441-9f3029bed990 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:01.263668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 242/491] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:01.265432 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.265894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.266344 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.284965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:01.286235 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:01.304630 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:01.305794 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.306309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.306692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.308413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:01.308975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:01.311806 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:01.348103 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:01.364895 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 243/492] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:01.366621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:01.384938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 250/493] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:01.384938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:01.510896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5f766-6e2c-4564-844b-a976e8965018 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:01.527277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:01.552375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:01.553188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.553473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.553747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.555084 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97417e-526b-45aa-9302-bfd09393b795 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:01.566209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:01.574337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:01.575868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 244/494] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:01.577100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:01.623777 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:01.624781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.625235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.625685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.638272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:01.640919 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:01.668681 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:01.670673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 251/495] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:01.672751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:01.773286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432cb44-aca7-460c-b91c-c119163ace0d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:01.783607 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:01.831301 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:01.832436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.832902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.833384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.871945 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa901a9-f04c-4ee0-8ae0-811f535986f9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:01.903574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:01.936995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:01.938286 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:01.938700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:01.939734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:01.949493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:01.951048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:01.957041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:01.965335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:01.968325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 252/496] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:01.969957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.138066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e57811-7b9a-4c0f-bc37-475585abd204 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.141441 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 245/497] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:02.142902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.172220 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:02.197227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.197908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.198193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.198634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.199478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:02.199810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.201372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:02.213171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 253/498] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:02.214411 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.251534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:02.294308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0fcb-6e84-450f-b491-fa149b8982ce None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.346458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.347587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fe640-fa94-4d36-a63d-ee6bf19e0946 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.347734 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.348209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.348682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.350367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:02.350916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.353868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:02.391365 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.392888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.393649 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.394100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.395510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:02.396026 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.398514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:02.413978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 254/499] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:02.415794 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.424486 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 246/500] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:02.424486 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.482223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:02.565667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244759d-f2ef-4e3f-9c88-0f2ed33d7e34 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.569335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3b2a-f607-4957-bb68-32fe1aa57c81 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.606857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:02.611472 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.612888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.613393 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.613884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.613998 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.614688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.614967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.615282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.627778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.629346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:02.636385 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.639453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:02.649901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:02.651601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:02.653438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:02.653438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:02.653438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:02.653438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:02.653438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 247/501] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:02.653438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:02.678690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:02.679979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:02.681091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:02.681091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:02.681091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:02.681091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:02.682017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 255/502] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:02.683024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.802962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:02.813052 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628788-24f2-4648-bd86-6490183fe588 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.816541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328e3e7-9429-4e4e-8145-8393ded3effc None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:02.853898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.854699 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.855004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.855293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.868860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:02.869523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:02.869808 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:02.870087 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:02.870869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.872391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:02.892722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:02.893763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:02.899510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:02.899510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:02.899510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:02.899510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:02.899510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 248/503] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:02.899510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:02.942296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:02.971507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:02.973275 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.059110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc0ad9-67e8-40c8-88c4-b277afaac823 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.084179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:03.097708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 256/504] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:03.098664 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.110331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.111756 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.112037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.112309 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.113045 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:03.113348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.114740 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.128807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 249/505] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:03.129861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.262911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aee66-5ef5-4efe-bacd-99b3e69930c9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.275816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:03.284856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c9f8-e344-40a4-8f43-8e4394254663 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.312653 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.313370 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.313650 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.314529 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.315326 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:03.315685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.317116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.337335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 257/506] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:03.337335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.341013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.342175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.342691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.343241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.344556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:03.345875 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.348663 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.371361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 250/507] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:03.372915 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.400748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:03.465638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1239-0254-418c-bbba-ac52393daabb None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.507251 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.508289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.508685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.509050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.512433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bdb70-a9f2-4b88-978f-6f0c56235ffb None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.522822 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.524232 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:03.543779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:03.544861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:03.546359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:03.546359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:03.546359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:03.546359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:03.546359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 258/508] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:03.546359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.559862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.560812 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.561097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.561384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.571259 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.573352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:03.591655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:03.592784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:25:03.593854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:03.596499 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 251/509] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:03.597476 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.624767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:03.715133 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a841-7404-4215-8fa2-2572876f4bd7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.718522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:03.761705 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7783-0d3e-495a-82b6-2bf38dbe8f51 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.769085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.770087 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.770433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.770766 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.779051 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.780456 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:03.797906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:03.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 259/510] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:03.803043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.824987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:03.825878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:03.826097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:03.826365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:03.836414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:03.837918 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:03.854313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:03.855961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 252/511] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:03.857506 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:03.965041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dfcd4-25dc-4e19-9cd2-5131b922b126 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:03.972040 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.007964 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae023e04-6167-4409-b592-3b64c80b9c01 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:04.016085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.016775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.017749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.018506 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.019835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:04.020147 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.022134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.036719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 260/512] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:04.037494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.057115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.058174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.058639 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.059181 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.060382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:04.060884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.063503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.075024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.100008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 253/513] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Jul 14 14:25:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:04.100008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.211755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fa2dd-fad1-4b43-91a8-c5c4c4dfce79 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:04.271383 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb6745-6517-4452-93ce-90bce2398c63 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:04.272180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.272925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.273273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.273613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.274662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:04.275162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.277442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.302814 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 261/514] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:04.303973 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.331286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.339403 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.340416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.340818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.341204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.342183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:04.342587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.344318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.371045 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 254/515] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:04.372676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.440599 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.461860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a7ed-0658-4c53-8dce-b52227bafc62 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:04.509420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65925cb-c5fb-468c-aa26-1e4e9b7aec9a None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:04.521208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.522605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.523127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.523619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.536959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.540136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.550883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.552053 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.552538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.553051 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:04.569831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:04.570738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:04.571645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:04.572368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 262/516] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:04.573693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.654547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.671846 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.674731 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.721720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f2330-50b7-48bc-8044-d2c3f6758b06 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:04.774604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:04.775570 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:04.775944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:04.776310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:04.777569 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=a69be22bfe524d48a0f2932f83694f5a) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:04.778011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:04.779994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:04.788045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 263/517] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/role_assignments?user.id=a69be22bfe524d48a0f2932f83694f5a&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:04.789505 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.811436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.845602 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 255/518] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:04.845602 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:04.987596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062a574-9da0-40da-88bc-cc13da724098 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.005291 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.028093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0722398-0697-4a0d-9544-39c0e803b3ce None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.051731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.053044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.053813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.054098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.074108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.074691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.075027 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.075308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.076075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:05.076385 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.078264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.099566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 256/519] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:05.100534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.157285 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.159849 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.173692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.226760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b181d-8ad4-4c78-93b4-9c111fa5f168 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.265772 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446629c6-101a-4767-a283-895ad5067723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.266706 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446629c6-101a-4767-a283-895ad5067723 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.267624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446629c6-101a-4767-a283-895ad5067723 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.267993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446629c6-101a-4767-a283-895ad5067723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.280773 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446629c6-101a-4767-a283-895ad5067723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.282396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446629c6-101a-4767-a283-895ad5067723 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.293994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 264/520] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:05.293994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-446629c6-101a-4767-a283-895ad5067723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:05.307760 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:05.308703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:05.309538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:05.309538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:05.309538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:05.309538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:05.309538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 257/521] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:05.310221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446629c6-101a-4767-a283-895ad5067723 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.317607 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.426502 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc208de-f4f8-40c4-baf2-8b8f98f1414e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.446408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.462304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446629c6-101a-4767-a283-895ad5067723 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.482804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.483514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.483799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.484076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.484930 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=02274dd74048403fa814884ad73c7ef2) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:05.485240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.487769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.495345 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 265/522] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/role_assignments?user.id=02274dd74048403fa814884ad73c7ef2&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:05.496309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.526563 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.527627 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.528304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.528675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.546082 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.547831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:05.573667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:05.574646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:05.575666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:05.575666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:05.575666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:05.575666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:05.575666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 258/523] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:05.582184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.663456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.665169 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89283b4-1b7b-4d32-83f0-4e06886b8d81 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.719106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.719106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.719106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.719106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.719521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:05.719521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.719521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.753247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 266/524] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:05.756063 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a029-96df-4c48-8a39-43e7e1effc4e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.765407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.817121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.821229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.822094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.822514 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.822795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.823595 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:05.823895 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.825331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.841926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 259/525] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:05.848827 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:05.904810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981e9d0-95bb-4cc3-879b-e92d3785fe84 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:05.946248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:05.947099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:05.947384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:05.947658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:05.956441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:05.958033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:05.976760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:05.977698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:05.978626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 267/526] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:05.984758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:06.010212 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d98722-2841-4aec-bd98-a154f5bc823f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:06.027343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:06.053843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:06.054653 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:06.054936 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:06.055242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:06.063285 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:06.065340 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:06.085075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:06.086000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:06.086837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 260/527] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:06.093894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:06.138518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:06.153432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b705a-59ba-48da-bff4-8045ec055766 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:06.204997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:06.206850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:06.207729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:06.208235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:06.209459 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:06.210389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:06.212408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:06.220927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c10b2-0fc6-424a-a3c9-cf83cde1b8de None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:06.234410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 268/528] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:06.237968 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:06.269742 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:06.270477 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:06.270764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:06.271067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:06.271877 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:06.272188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:06.273813 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:06.296158 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 261/529] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:06.297630 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:06.352876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:06.380901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3dfd6-b763-402e-8464-0e35f4d0d3d5 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:06.423509 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:06.424273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:06.424549 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:06.424823 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:06.425736 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=22fcac88391d48e1a19591ab0ac05210) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:06.426053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:06.427596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7646912-868f-40f4-ab15-aebbd9a2075e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:06.443771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 269/530] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:06 2022] GET /identity/v3/role_assignments?user.id=22fcac88391d48e1a19591ab0ac05210&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:06.459465 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058184-f81d-413f-8378-a166403a1811 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:06.505863 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:06.506460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:06.506745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:06.507051 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:06.507951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=ef8b686560994350b28cd4c6016b4fda) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:06.508267 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:06.509940 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9f930-6ef3-4569-8f84-78443c7ef57c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:06.518165 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 262/531] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:06 2022] GET /identity/v3/role_assignments?user.id=ef8b686560994350b28cd4c6016b4fda&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:07.918117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add247e2-7733-437b-9bcd-388fcbd02bda None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:07.918765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add247e2-7733-437b-9bcd-388fcbd02bda None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:07.918765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add247e2-7733-437b-9bcd-388fcbd02bda None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:07.920512 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 270/532] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:07.927514 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:07.928291 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:07.928291 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:07.948797 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:07.950188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:08.093931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 263/533] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:08.118955 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add247e2-7733-437b-9bcd-388fcbd02bda None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:08.146686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:08.305226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add247e2-7733-437b-9bcd-388fcbd02bda None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:08.350539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:08.351408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.351693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.351966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.367588 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:08.375759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:08.378241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:08.379836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:08.383318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 271/534] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:08.385219 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:08.441181 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:08.546586 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363966-17c3-4dee-93be-a72751e7e747 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:08.589167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:08.589752 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.590031 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.590286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.591106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:08.591411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:08.592830 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82961b66-a3df-428b-bf8a-98273f7c74b3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:08.603977 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 264/535] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:08.609986 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:08.765098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:08.811400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80980-c3a6-4434-a6ee-b9610638f74d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:08.824816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6386e56-a5b3-4e27-a9db-8280fe529c4f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.825453 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6386e56-a5b3-4e27-a9db-8280fe529c4f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.825933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6386e56-a5b3-4e27-a9db-8280fe529c4f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.828373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 265/536] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:08.834451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.835107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.835583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.856374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:08.858265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:08.886365 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:08.887721 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:08.888210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:08.888674 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:08.908310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:08.909819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:08.935152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:08.936598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:08.937526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:08.937526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:08.937526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:08.937526 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:08.941023 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 272/537] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:08.947742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:08.968129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 266/538] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:25:08.996719 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:09.026969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:09.129742 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325554-744c-45c2-b3ea-97650024c9ed None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.155370 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a2c33-148d-4e05-8e71-94f43588af92 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.176739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:09.177583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.177871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.178154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.192337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:09.200439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:09.202068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:09.203589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 267/539] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:09.209083 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:09.216984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:09.226587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:09.227329 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.227613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.227892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.228642 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:09.228953 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:09.230390 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:09.249336 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 273/540] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:09.251690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:09.391255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:09.406990 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1585-a4c7-4226-aea1-9b1026937f37 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.435015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecfcf8-2de6-4686-afa3-f69c84d51005 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.458615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:09.459479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.459760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.460033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.471012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:09.473320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-09ac7d26-949c-48c3-9db1-9a1c5330f22c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:09.490313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:09.492311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 274/541] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jul 14 14:25:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ccf9-046a-4eb2-b85e-c1c8531df76f None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.494030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ccf9-046a-4eb2-b85e-c1c8531df76f None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.496577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ccf9-046a-4eb2-b85e-c1c8531df76f None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.496577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 275/542] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:09.497469 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ccf9-046a-4eb2-b85e-c1c8531df76f None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:09.526658 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:09.527394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.527690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.528462 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.528778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:09.529175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:09.530539 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1799408-eee8-4285-a932-09f152860c8a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:09.552922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 268/543] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:09.552922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.552922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.552922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.581411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:09.583431 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:09.603773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:09.683120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ccf9-046a-4eb2-b85e-c1c8531df76f None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.699496 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 269/544] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:09.699496 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:09.744162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:09.745562 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.746046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.746343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.747272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:09.747584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:09.749128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:09.771003 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 276/545] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jul 14 14:25:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:09.771887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:09.820256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:09.861606 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686aecb-b3ff-4892-b2f1-e8713c9ed11e None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.916073 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:09.917361 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:09.917813 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:09.918263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:09.936030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:09.938304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:09.951525 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7919-f12f-4be4-a28d-9e1ed8bbced4 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:09.965673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:09.971393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:09.972839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:09.973908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:09.973908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:09.973908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:09.973908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:09.973908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 270/546] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:09.975116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.012069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ccf8b-e336-4e24-b700-ff1c6e3ba38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.013141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ccf8b-e336-4e24-b700-ff1c6e3ba38e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.013501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ccf8b-e336-4e24-b700-ff1c6e3ba38e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.013842 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ccf8b-e336-4e24-b700-ff1c6e3ba38e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.028554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ccf8b-e336-4e24-b700-ff1c6e3ba38e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-093ccf8b-e336-4e24-b700-ff1c6e3ba38e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:10.038141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:10.040295 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:10.042030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 277/547] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:10.044908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188634-6b50-4f10-a72b-e7794c871b89 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.044908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188634-6b50-4f10-a72b-e7794c871b89 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.044908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188634-6b50-4f10-a72b-e7794c871b89 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.046225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 278/548] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:10.049748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5188634-6b50-4f10-a72b-e7794c871b89 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.121217 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6b10-50a2-40b0-a9c9-009d05abdd91 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.152759 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:10.172770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.175402 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.175896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.176402 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.193216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:10.194628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:10.203854 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5188634-6b50-4f10-a72b-e7794c871b89 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:10.216823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:10.218559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:10.221871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:10.221871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:10.221871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:10.221871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:10.221871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 271/549] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:10.221871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.258350 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.259288 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.259669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.260085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.261017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:10.261495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:10.263058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6871-c1a1-4eff-91b4-03b51cafe989 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:10.277185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 279/550] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:10.278508 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.278794 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.279111 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.298684 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:10.300472 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:10.325405 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:10.376203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c30aa-073e-4187-819b-cfc000f87616 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.389584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 280/551] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:10.390714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.442120 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.443559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.444007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.444503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.445944 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:10.446495 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:10.449791 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:10.466124 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 272/552] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:10.467710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.530892 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:10.542718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7765d-001d-4267-bfd6-7c60f87b28de None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.592560 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.593606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.594067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.594513 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.596395 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:10.596892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:10.599197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:10.624072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 281/553] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:10.624072 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.632781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1f66-ccf3-4965-9480-4952203a4482 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.644156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:10.684851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.685668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.685996 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.686212 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.696154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:10.697540 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:10.714110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:10.716375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 273/554] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:10.718294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.780334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a73f8-254d-40cc-8a77-ea7cd5cb3df7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.835217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.836533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.836991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.837441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.854530 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:10.863555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:10.865289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 282/555] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:10.866519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:10.886112 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:10.892152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb215-bdf7-45f2-baf1-72eecb1bb8ca None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:10.933242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:10.934052 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:10.934338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:10.934618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:10.947928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:10.949606 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:10.969512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:10.971289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:10.974178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:10.974178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:10.974178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:10.974178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:10.974178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 274/556] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:10.974178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.011573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:11.044999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295fc0-d4fb-4385-adf4-bb2be950c014 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.087309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.088104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.088381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.088650 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.097374 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.098877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:11.115677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:11.117325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 283/557] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:11.119757 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.147741 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14142d-c5ee-4230-8b50-dc5a65d752ef None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.205310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.206116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.206389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.206668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.207582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:11.207893 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.209411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.229775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 275/558] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jul 14 14:25:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:11.230660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.247451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:11.260846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a406f-d6b4-4b8d-b1d2-2b2f6198f654 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.313187 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.315037 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.315485 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.315923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.317215 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:11.317707 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.319900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.324084 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:11.340735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 284/559] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:11.340735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.394264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519877ea-bac1-450a-bd1f-55d16c6d81b8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.449832 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.450617 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.450956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.451453 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.452535 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:11.452901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.455467 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.467870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63325838-138a-4d53-a118-28fb41f3bda0 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.473239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 276/560] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:11.474485 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.528343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.529163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.529501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.529844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.530738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:11.531168 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.533416 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.549304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 285/561] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:11.551095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.579646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:11.630397 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667282a3-bc46-455a-a5cb-b8c629b0d771 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.635604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:11.679983 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.680794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.681203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.681490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.696022 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.697633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3628c1-b9d5-40c9-9330-391bb9695394 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.698577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:11.724992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:11.726767 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:11.728973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:11.728973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:11.728973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:11.728973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:11.728973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 277/562] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:11.730168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.755981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.756829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.757128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.757410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.770712 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.772247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:11.793436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:11.795541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:11.797466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:11.797466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:11.797466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:11.797466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:11.797466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 286/563] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:11.797466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.870921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbe40a-6987-42d3-9cd2-db3ae1816073 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.895731 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:11.915634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:11.916594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:11.916946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:11.917372 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:11.927905 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:11.929837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:11.946880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:11.948168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 278/564] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:11.950406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:11.959734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d490c2-b6c8-4062-8ef9-121db999882c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:11.981004 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.010058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.011261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.011536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.011861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/a69be22bfe524d48a0f2932f83694f5a/roles/77834b1268574ab9a1fff71598d4758e` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.033241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=a69be22bfe524d48a0f2932f83694f5a, role_id=77834b1268574ab9a1fff71598d4758e)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.035178 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.050856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 287/565] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:25:11 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/a69be22bfe524d48a0f2932f83694f5a/roles/77834b1268574ab9a1fff71598d4758e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:25:12.051864 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.120715 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a56cf-6498-4e7f-8972-35606c423b16 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:12.178584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.179751 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.180227 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.180699 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.182096 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:12.182621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.184980 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.207191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 279/566] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:12.212630 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.213945 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d895-b383-43b6-b709-c57606b59402 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:12.274211 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.278378 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.279688 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.280182 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.280677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.282059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:12.283383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.286113 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.315714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 288/567] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:12.319217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.369144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.374409 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6005-0b28-4bcd-8f20-a5e9c47376ac None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:12.437208 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.438081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.438890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.439503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.441068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:12.441579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.444270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.480190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 280/568] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:12.480190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.528611 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1a86a-c4af-4e9e-af7a-6265624b449b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:12.581445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.582262 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.582544 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.582816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.591429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.592930 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:12.610214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:12.612734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:12.614803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:12.617193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 289/569] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:12.618261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.678489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.684105 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afa7de-1b79-481e-bfd6-d09dcc9c0641 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:12.733869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.734683 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.734960 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.735296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.750129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.755232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:12.774127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:12.776017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 281/570] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:12.778678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.790802 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.831740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5366-96ba-4b22-af56-134730c8dead None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:12.897709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:12.899099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:12.899543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:12.899971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:12.918064 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:12.920649 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:12.951097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:12.952975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:12.955399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:12.955399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:12.955399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:12.955399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:12.959509 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 290/571] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:12.961166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:12.986683 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2600d2-91df-479a-9d53-861a65f5aa10 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.053337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.054288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.054754 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.055262 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.057445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:13.057954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.060527 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.080096 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 282/572] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:13.081612 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:13.111132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.158934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51827309-ed0e-464d-9631-03d0e5a1e9c0 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.214553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.225648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.226948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.227548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.228114 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.229879 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:13.230538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.233404 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.248179 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69030-71a2-4545-88aa-e05f59cae390 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.263445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 291/573] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Jul 14 14:25:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:13.265186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:13.316157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.317420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.317922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.318416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.319896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:13.320441 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.323127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.350475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 283/574] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:13.351766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:13.455776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ba88-0336-4577-b523-d85141ce2b29 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.488774 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.514073 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.515053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.515492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.516045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/02274dd74048403fa814884ad73c7ef2/roles/77834b1268574ab9a1fff71598d4758e` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.533529 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2144b6d-e57c-439a-a66a-a3b2bde27ba3 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.544329 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=02274dd74048403fa814884ad73c7ef2, role_id=77834b1268574ab9a1fff71598d4758e)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.546918 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.568969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 292/575] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:25:13 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/02274dd74048403fa814884ad73c7ef2/roles/77834b1268574ab9a1fff71598d4758e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:25:13.570594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:13.607777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.609436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.610157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.611551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.640945 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.646057 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.684629 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:13.688246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:13.691512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:13.693674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:13.693674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:13.693674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:13.693674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:13.696253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 284/576] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:13.704135 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:13.854732 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7d38e-459c-40c8-93bf-61fa6b516995 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.902094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898b4b-6938-43f0-9853-f35268677c32 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:13.937301 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.939505 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.940191 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.940651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.959940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.963427 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.964013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.967561 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:13.968886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:13.969524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:13.970869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:13.972447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:13.973145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:13.976382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:13.999837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:14.000845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:14.002328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:14.003966 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 285/578] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:14.007133 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 293/578] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:14.012380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:14.019271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:14.149298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:14.153880 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b4f9-bae5-4a0e-873e-bdb6179b2afa None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:14.208013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c926e-c215-4688-95b3-8742848bbb3c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:14.220830 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:14.222151 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.222719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.223383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.225179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:14.225820 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:14.229069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:14.256668 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 294/579] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:14.258900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:14.265865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:14.268956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.269584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.270175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.284828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:14.287871 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:14.317873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:14.318939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:14.319963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:14.331186 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 286/580] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:14.333347 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:14.419229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:14.443567 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ac04e-cffe-4b3a-bf0c-45dbd52c7be5 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:14.489885 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b333-d15d-42be-b8cf-766ccb2fa08c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:14.512658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d49ff-e3be-4d05-8f53-91674df9b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:14.514452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d49ff-e3be-4d05-8f53-91674df9b67c None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.515177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d49ff-e3be-4d05-8f53-91674df9b67c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.515807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d49ff-e3be-4d05-8f53-91674df9b67c None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/ef8b686560994350b28cd4c6016b4fda/roles/77834b1268574ab9a1fff71598d4758e` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.534840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:14.535848 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.536282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.536714 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.537786 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:14.538257 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:14.540193 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:14.548866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d49ff-e3be-4d05-8f53-91674df9b67c None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=ef8b686560994350b28cd4c6016b4fda, role_id=77834b1268574ab9a1fff71598d4758e)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:14.552384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d49ff-e3be-4d05-8f53-91674df9b67c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:14.556426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 287/581] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:14.567586 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:14.582809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 295/582] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:25:14 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/ef8b686560994350b28cd4c6016b4fda/roles/77834b1268574ab9a1fff71598d4758e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:25:14.721028 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919468e-00f3-4efd-805d-5edb85ac40ff None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:14.737172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:14.769588 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77e35e-65b4-48f4-955d-e8a6b1318f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:14.770857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e35e-65b4-48f4-955d-e8a6b1318f9b None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.771396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e35e-65b4-48f4-955d-e8a6b1318f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.771855 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e35e-65b4-48f4-955d-e8a6b1318f9b None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/22fcac88391d48e1a19591ab0ac05210/roles/77834b1268574ab9a1fff71598d4758e` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.790451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77e35e-65b4-48f4-955d-e8a6b1318f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=22fcac88391d48e1a19591ab0ac05210, role_id=77834b1268574ab9a1fff71598d4758e)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:14.792309 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77e35e-65b4-48f4-955d-e8a6b1318f9b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:14.812371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 288/583] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:25:14 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/22fcac88391d48e1a19591ab0ac05210/roles/77834b1268574ab9a1fff71598d4758e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:25:14.889788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524273bf-8a55-45dd-ace7-69d583ac25e5 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.890385 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524273bf-8a55-45dd-ace7-69d583ac25e5 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.890927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524273bf-8a55-45dd-ace7-69d583ac25e5 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.892916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 296/584] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:14.900068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:14.900388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:14.900686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:14.920682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:14.921987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:15.009985 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 289/585] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:15.036752 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524273bf-8a55-45dd-ace7-69d583ac25e5 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:15.052556 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:15.174934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524273bf-8a55-45dd-ace7-69d583ac25e5 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:15.218799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f04076-a270-409d-be62-2f37954935ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:15.219718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04076-a270-409d-be62-2f37954935ec None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:15.220053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04076-a270-409d-be62-2f37954935ec None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:15.220328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04076-a270-409d-be62-2f37954935ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:15.233717 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f04076-a270-409d-be62-2f37954935ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-98f04076-a270-409d-be62-2f37954935ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:15.241906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:15.242913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:15.243778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 297/586] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:15.252969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:15.420394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:15.441490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac7c4-9d87-42d8-bf23-7b480b3b2757 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:15.497755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:15.498854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:15.499380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:15.499859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:15.500841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:15.501973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:15.503677 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:15.513840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 290/587] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:15.522846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f04076-a270-409d-be62-2f37954935ec None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:15.672285 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:15.745334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f04076-a270-409d-be62-2f37954935ec None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:15.819197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:15.820704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:15.821189 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:15.821661 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:15.844974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:15.848405 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:15.883801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:15.884740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:15.885626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:15.885626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:15.885626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:15.885626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:15.886531 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 298/588] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:15.895332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:16.026410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66fa2-1e05-449e-899e-2560a0aeb0d1 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:16.071629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:16.072738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.073242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.073748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.074730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:16.075280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:16.076976 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30332e-d358-4dac-ac62-45597b23e2d6 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:16.093084 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 291/589] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:16.104085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:16.300172 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a8e2-284c-4d5d-9460-af88a03d3bf8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:16.328245 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.352449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:16.353807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.354310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.354785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.371383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:16.374174 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:16.404574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:16.405587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:16.406617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:16.407338 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 299/590] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jul 14 14:25:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:16.416145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170b3f6-4bd6-4751-882a-2931c35e6adb None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.416490 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:16.416975 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170b3f6-4bd6-4751-882a-2931c35e6adb None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.417435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170b3f6-4bd6-4751-882a-2931c35e6adb None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.419380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 292/591] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:16.434221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.435492 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.435992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.456130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:16.457738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:16.472642 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.555566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 293/592] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:25:16.576475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:16.647447 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113f8d-e657-4281-a2fe-6c76b798f561 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:16.715232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467f29-0b66-4d7f-8470-5e5b55290574 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:16.728432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:16.729870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.730384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.730859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.732013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:16.732544 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:16.734355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:16.756492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 300/593] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jul 14 14:25:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:16.762300 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:16.769682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:16.770546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:16.770838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:16.771153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:16.787814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:16.797551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:16.799831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:16.801358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 294/594] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:16.815575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:16.821079 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.831461 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.957659 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc8c0-d20c-40ea-b9c9-def4d4d4058c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:16.991125 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acca5-437c-49ad-b0b1-8cb27995bab7 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:17.032254 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50ddf-ca1a-4039-94c5-2ad993273296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:17.033799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50ddf-ca1a-4039-94c5-2ad993273296 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.034613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50ddf-ca1a-4039-94c5-2ad993273296 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.035441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50ddf-ca1a-4039-94c5-2ad993273296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.036906 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:17.037680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.038032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.038378 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.039292 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:17.039668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:17.041440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:17.053550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 295/595] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:17.062417 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:17.158381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50ddf-ca1a-4039-94c5-2ad993273296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:17.162115 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50ddf-ca1a-4039-94c5-2ad993273296 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:17.168573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:17.221900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:17.253040 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec7dbc-e5dc-49ec-8b7e-1b9347700dc8 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:17.296753 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:17.297623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.297961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.298241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.304311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 301/596] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:17.306452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb584-74e2-4a40-8589-5fcc7c813263 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.306912 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb584-74e2-4a40-8589-5fcc7c813263 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.308030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb584-74e2-4a40-8589-5fcc7c813263 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.315052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 302/597] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:17.315052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb584-74e2-4a40-8589-5fcc7c813263 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:17.316630 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:17.318132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-f686e07c-a577-4a1b-a204-daa6fb033903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:17.338341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:17.339582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:17.340473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:17.340473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:17.340473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:17.340473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:17.343156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 296/598] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:17.346169 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.346613 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.347510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.366752 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:17.368183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:17.493100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb584-74e2-4a40-8589-5fcc7c813263 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:17.496458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 297/599] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:17.498139 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:17.551852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:17.552675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.553033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.553307 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.566498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:17.571553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:17.576564 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:17.597554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:17.608110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:17.610055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:17.613977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:17.613977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:17.613977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:17.613977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:17.619248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 303/600] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:17.620751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:17.706561 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77db3ca-ef8e-48d6-bb8b-6fc78c8eb207 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:17.767523 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:17.768534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.769003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.769456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.770722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:17.771304 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:17.773689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:17.796447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 298/601] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:17.798507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:17.834388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d6912-8e03-4538-96fe-e465d575f65f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:17.899246 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:17.900504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:17.900967 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:17.901409 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:17.920979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:17.934528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:17.936440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:17.937884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:17.943504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 304/602] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:17.946688 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:17.977546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca3851-a12a-4ee1-a687-8654a16d50ba None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:17.988973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.028072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dc125-4bee-4508-a449-34943425601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.028856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dc125-4bee-4508-a449-34943425601a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.029282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dc125-4bee-4508-a449-34943425601a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.029699 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dc125-4bee-4508-a449-34943425601a None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.030584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dc125-4bee-4508-a449-34943425601a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:18.031058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dc125-4bee-4508-a449-34943425601a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.033328 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dc125-4bee-4508-a449-34943425601a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.056798 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 299/603] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:18.056798 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dc125-4bee-4508-a449-34943425601a None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.072393 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.165843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6bb60-a34e-431b-86fb-bb8d54aa1b18 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.222824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dc125-4bee-4508-a449-34943425601a None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.232651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.234195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.234664 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.235918 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.253456 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.256603 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.279136 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.279938 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.280366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.280776 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.281722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:18.282320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.285225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:18.290768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:18.292639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 305/604] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:18.295975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.306535 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 300/605] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:18.308110 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.365973 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.472130 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a4122-2ac1-4aa3-a98a-7f9bc990ff6e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.483689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef09f-a39c-4821-99d1-91839cd503a4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.489555 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.524828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.525696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.525890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.526060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.526896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:18.527483 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.527633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.529028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.529221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.529533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.530030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.544572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.547195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.554062 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 301/606] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:18.554949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-07cebe24-dcf4-46e9-a369-70ec4840aeee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:18.574909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:18.576102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:18.577192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 306/607] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:18.580083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f412e-9763-4af0-a30f-12112d0197ed None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.580654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f412e-9763-4af0-a30f-12112d0197ed None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.581054 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f412e-9763-4af0-a30f-12112d0197ed None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.583703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 307/608] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:18.585843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f412e-9763-4af0-a30f-12112d0197ed None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.664343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.686363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf65ed-fb1c-4703-8a1d-0dd96284057a None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.728008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.728820 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.729106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.729385 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.730841 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f412e-9763-4af0-a30f-12112d0197ed None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.742009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.743564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:18.763249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:18.771126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:18.772098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:18.772098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:18.772098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:18.772098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:18.772098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 302/609] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:18.772098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.778261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.778928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.779296 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.779521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.835468 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.868633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.870119 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.909934 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1cea9-24d8-4727-a4c9-272d81f35d8a None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:18.953156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:18.955023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.955388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.955741 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.956676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:18.957097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:18.961761 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bb1c1-fd13-46dc-99fc-fd2ae21a5341 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:18.969433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:18.975730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 303/610] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:18.976916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:18.977201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:18.977473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:18.993217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 308/611] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:18.994091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:18.995167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:18.996512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:19.072039 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.078797 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 304/612] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:19.080071 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.116720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fec3a-50d8-4691-81cf-5d4de8158c99 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.158824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.160665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.161791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.162251 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.163245 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:19.163653 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.165849 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.179365 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 309/613] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:19.180241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.205559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9720-54fe-434c-ac69-d722dd00097d None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.235112 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.244436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.245117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.245404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.245683 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.246533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=a69be22bfe524d48a0f2932f83694f5a) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:19.246850 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.248372 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.256125 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 305/614] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/role_assignments?user.id=a69be22bfe524d48a0f2932f83694f5a&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:19.257002 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.309132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e106c-cae3-4af9-bc8e-e5fb85909cb9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.355049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.362709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.364590 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.365848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.365848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.380724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.382583 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:19.404984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:19.407163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:19.417713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:19.417713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:19.417713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:19.417713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:19.417713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 310/615] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:19.417713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.437182 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303264b-69b2-420d-b217-ff7836809cea None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.504670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.505492 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.506150 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.506150 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.521537 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:19.531024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:19.534668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 306/616] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:19.535583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.571967 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435a90a-bc69-424f-b262-ac8760d2c19e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.610956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.637309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.638125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.638413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.638708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.649141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.650638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:19.667747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:19.669648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 311/617] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:19.671597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.705801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9888e-69fe-46e8-bc4f-1127a268d4f9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.733890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.749478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.750175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.750494 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.750727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.752394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:19.752712 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.754164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.783032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 307/618] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:19.783032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.830231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc420115-3db5-451c-acd2-ed934bad229f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.890094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.890917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.891548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.892597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.893587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:19.894258 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.896921 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:19.911864 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 312/619] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:19.915459 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:19.938237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3f27-b140-4caa-88ad-f31a66de00d5 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:19.961227 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:19.994766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:19.995772 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:19.996206 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:19.996537 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:19.997660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:19.998123 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:19.999990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.026564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 308/620] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:20.028058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.074919 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018cf0a-b170-4ee6-82f1-fbc07cf082b2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.085503 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:20.123796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.124979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.125554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.126053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.135703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.137660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:20.159118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:20.160877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 313/621] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:20.163557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.187093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0f57-b54d-4c44-9ac3-dc328cc80b64 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.239862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.241072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.241587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.242104 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.257252 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.259228 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:20.284795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:20.286545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:20.289493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:20.289493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:20.289493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:20.289493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:20.289493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 309/622] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:20.289493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.305691 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac7ec5-7e9e-4f53-a988-343a12a5f715 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.326836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:20.359540 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.361689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.362219 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.362662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.412507 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:20.436916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed0282-aaa0-446a-8d97-20d967f58d7f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.482294 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.484814 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.493215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.494298 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.495691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.496258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.497364 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:20.498390 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.501564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.518494 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 310/623] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:20.518494 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.636090 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 314/624] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:20.637422 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.654711 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:20.687096 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026f56-62d3-4e6d-804f-0c362249aaa2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.740498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:20.753667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.754545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.754942 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.755369 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.756266 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:20.756718 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.758437 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.779250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 311/625] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:20.779250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.815423 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cc0d7-180d-426f-af6d-514145bded0a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.889156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.890296 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.890856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.892691 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.894414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=02274dd74048403fa814884ad73c7ef2) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:20.895190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.898025 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.898257 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147165b4-14ba-487f-b179-092e66931e4d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:20.910733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 315/626] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/role_assignments?user.id=02274dd74048403fa814884ad73c7ef2&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:20.912446 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:20.953414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:20.955307 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:20.955868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:20.956927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:20.978991 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:20.982141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:20.984851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:21.008873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:21.009853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:21.010724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:21.010724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:21.010724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:21.010724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:21.010724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 312/627] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:21.018480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:21.124900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae39c-1e22-47d4-8b10-ea4141363275 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.171015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b1863-6d6e-4e5b-9910-c16607842eb4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.172007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:21.181298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:21.182495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:21.183126 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:21.185183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:21.195863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:21.197368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:21.214519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:21.216922 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:21.218882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 316/628] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:25:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:21.228927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:21.229621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:21.229908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:21.230155 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:21.230890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:21.231246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:21.233009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:21.234736 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:21.247730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 313/629] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:21.254827 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:21.348866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:21.379091 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba5517-b67a-423c-ae0d-59841a3a974d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.421951 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86848a24-8e5c-414f-9997-307f2519978f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.426810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:21.428208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:21.428208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:21.428413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:21.429475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:21.429887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:21.431517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:21.460692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 317/630] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:21.466453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:21.489621 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:21.490531 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:21.490824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:21.491146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:21.500319 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:21.503507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:21.521957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:21.522928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:21.523862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:21.527383 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 314/631] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:21.529592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:21.552361 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:21.629312 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75ab84-3186-48f9-98da-de44e4e56f61 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.667762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c619e-c4ac-4835-b092-46ed37822488 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.684941 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:21.686404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:21.687899 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:21.689173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:21.689658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:21.719316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:21.720348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:21.721231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:21.721655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:21.722601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:21.723064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:21.724660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:21.739055 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 315/632] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:21.746659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:21.794650 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:21.796357 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:21.866747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:21.955960 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe3938-8755-4159-95bc-107e37963699 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:21.975024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 318/633] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:21.978663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:22.016743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:22.017476 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.017864 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.018113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.019013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=ef8b686560994350b28cd4c6016b4fda) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:22.019357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:22.020954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:22.035021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 316/634] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/role_assignments?user.id=ef8b686560994350b28cd4c6016b4fda&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:22.165145 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a222618-befa-4cd9-a179-99b488ac81bc None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:22.243944 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:22.245741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.246480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.247190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.271908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:22.275238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:22.296590 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-9a36b887-22e2-404c-b0cc-471b4ee6da2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:22.311697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:22.313634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:22.315444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:22.315444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:22.315444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:22.315444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:22.317658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 319/635] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:22.332061 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:22.421983 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.552115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791b24-ecb5-41ba-96f0-ddc5c0b6493c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:22.603807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b55e8d-5163-46ac-9f78-2e90dc70579e None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.604218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b55e8d-5163-46ac-9f78-2e90dc70579e None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.604415 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b55e8d-5163-46ac-9f78-2e90dc70579e None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.606551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 320/636] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:22.613479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.613890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.614432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.632063 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:22.632896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.633162 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.633450 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.634208 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:22.634515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:22.635977 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:22.651430 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:22.651828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 317/637] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:22.653500 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:22.663006 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:22.831805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 321/638] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:22.857924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:22.883869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.890430 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1135f1-6cea-4bb6-b48d-5d9f86050f6b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:22.952088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:22.953896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:22.954783 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:22.955773 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:22.968954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:22.974014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:23.009035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:23.010692 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:23.012458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:23.017806 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 318/639] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:23.031052 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:23.089448 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c23a1-de2c-418c-8a00-541a744b2f18 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:23.172104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:23.186328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:23.188111 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.189348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.189948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.214624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:23.232747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:23.233853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:25:23.234756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:23.236743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 322/640] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:23.243542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:23.257281 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681b14-13d4-4af9-ae55-da1db8ac1c62 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:23.351281 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:23.351862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.352145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.352421 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.353238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:23.353551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:23.355094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:23.372647 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 319/641] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:23.383319 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:23.408615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a69734-51c6-43f9-ba81-c0f0665f2c58 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:23.424008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:23.496022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:23.498045 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.498810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.499564 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.502253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:23.503740 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:23.506410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:23.524861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 323/642] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:23.531887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:23.601674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ba86-356b-4c84-bed1-041e6c6db387 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:23.629092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:23.648562 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:23.649236 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.649524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.649807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.650700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=22fcac88391d48e1a19591ab0ac05210) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:23.651077 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:23.652784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b7b49-8ef4-4b08-b3c9-fa4baa624139 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:23.659917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 320/643] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:23 2022] GET /identity/v3/role_assignments?user.id=22fcac88391d48e1a19591ab0ac05210&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:23.661305 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069cf7d-fa4b-48fb-a209-2135f48d7bc5 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.661575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069cf7d-fa4b-48fb-a209-2135f48d7bc5 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.661866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069cf7d-fa4b-48fb-a209-2135f48d7bc5 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.669687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 321/644] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:23.672585 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.672964 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.673181 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.696036 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:23.697299 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:23.740389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cb97-dbbf-4c96-84d3-d96dc102e78d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:23.800882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:23.802321 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:23.803511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:23.803511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:23.828616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:23.833542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:23.841525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 322/645] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:23.875523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:23.877811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:23.879846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:23.879846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:23.879846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:23.879846 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:23.883475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:23.884729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 324/646] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:23.892933 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:23.912179 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:24.105855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11515ce-744a-4e68-8892-6d69b470d50c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:24.111436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:24.120217 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1189fba-35e9-4d3b-99ce-82c5ceaf0ad9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:24.195015 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:24.196076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.196584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.197100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.197771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:24.198376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:24.198900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:24.199207 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.199624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.200189 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] PATH_INFO: `/v3/services/image` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.201435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:24.201718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:24.205137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:24.228158 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 325/647] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:24.235003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:24.237279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:24.238859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 323/648] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Jul 14 14:25:23 2022] GET /identity/v3/services/image => generated 86 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:24.246053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:24.248008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:24.389551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab337b3a-0d0d-4f34-8168-22711ab2ab6e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:24.418969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:24.460210 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d14a-ab56-4bbc-ba27-f979da6f8d26 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:24.469276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:24.470696 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.471245 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.471749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.487304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:24.490116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:24.515289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:24.516250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.517357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.517780 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.518701 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] RBAC: Adding query filter params (name=image) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:24.519257 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:24.520835 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:24.523775 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:24.524873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:24.525914 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:24.530191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 324/649] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:24.531125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 326/650] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jul 14 14:25:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:24.541030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:24.548673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:24.604214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:24.731254 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76954-782e-4764-bcb0-32dae1eb7267 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:24.766484 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618ada3-1298-4215-a36d-e4cefafdd780 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:24.793088 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:24.794286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.794804 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.795313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.796593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] RBAC: Adding query filter params (type=image) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:24.797121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:24.800060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:24.808336 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 325/651] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:24.834648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:24.836138 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:24.836643 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:24.837167 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:24.838271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:24.838809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:24.840705 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:24.866755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 327/652] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jul 14 14:25:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:24.880357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:24.885327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.028109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1163-e758-430a-9d03-de9f49402c3b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:25.077794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694f38e-0537-42c3-be73-398b5b8109d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:25.079517 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f38e-0537-42c3-be73-398b5b8109d1 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.080043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f38e-0537-42c3-be73-398b5b8109d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.080551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f38e-0537-42c3-be73-398b5b8109d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.169004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694f38e-0537-42c3-be73-398b5b8109d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:25.171016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694f38e-0537-42c3-be73-398b5b8109d1 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:25.175645 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.305651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 326/653] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:25.316783 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:25.441904 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.449092 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756dd6a-6db6-48dd-9956-6e13202efa47 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.449566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756dd6a-6db6-48dd-9956-6e13202efa47 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.450058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756dd6a-6db6-48dd-9956-6e13202efa47 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.459218 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 327/654] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:25.461642 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.465994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8345-5d91-492b-b9d7-755ddf35835c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:25.470758 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.471689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.502518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:25.505173 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:25.513274 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:25.514097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.514372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.514641 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.528728 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:25.530825 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:25.558582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:25.560299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:25.562083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:25.562083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:25.562083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:25.562083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:25.562083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 328/655] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:25.569471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:25.655039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 328/656] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:25.694629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:25.754869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7046-a4e1-4620-b020-df93f94e603c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:25.766171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.805985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:25.807275 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.807863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.808341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.809376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:25.809896 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:25.812279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:25.814873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:25.837754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 329/657] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:25.841148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:25.920311 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319483-d3a3-4061-9e1f-2689c0a4c054 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:25.990402 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:25.990706 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:25.991443 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:25.992008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:25.993376 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:25.996173 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:26.019680 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:26.021510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:26.023644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 329/658] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Jul 14 14:25:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:26.031154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:26.061496 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b7d8-ca26-4cb8-8ed8-46cacd156530 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:26.126273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:26.127627 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.128105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.128520 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.150384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:26.153490 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:26.191586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:26.193366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:26.195118 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:26.199117 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 330/659] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:26.203098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:26.239556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:26.243913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667862-3169-4fbd-874c-7f37b786bfc5 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:26.292129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:26.293303 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.293807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.294303 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.295976 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:26.296502 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:26.299822 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.315137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 330/660] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jul 14 14:25:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:26.320763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:26.334418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:26.448813 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26563-9c1b-4011-ba13-f0f89335516e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:26.534696 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:26.536444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.537318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.538264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.540725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:26.541680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:26.545011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.558352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6adef-0719-41b0-84ad-238684dee14d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:26.576185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 331/661] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:26.587086 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:26.644204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:26.645486 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.645939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.646417 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.648064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:26.648569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:26.651158 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d62b7-1f6a-4766-8fab-8f789e460902 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.667043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 331/662] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jul 14 14:25:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:26.795687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ffdcc-60f1-49ac-9087-8b698c046dc8 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.795993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ffdcc-60f1-49ac-9087-8b698c046dc8 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.796343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ffdcc-60f1-49ac-9087-8b698c046dc8 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.799106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 332/663] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:26.805007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.805270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.805556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.841286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:26.841802 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbbfc-bdaf-46f2-8810-94fe1316707a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:26.843992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:26.874624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:26.893322 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:26.925923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:26.927615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:26.928308 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:26.929144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:26.930927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=a69be22bfe524d48a0f2932f83694f5a) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:26.931755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:26.934725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:26.950205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 332/664] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:26 2022] GET /identity/v3/role_assignments?user.id=a69be22bfe524d48a0f2932f83694f5a&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:27.010137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 333/665] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:25:27.057073 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:27.191903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab2d3-f422-4408-bb47-12baced89ec1 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:27.233030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:27.233875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:27.234173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:27.234435 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:27.235231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:27.237060 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:27.254161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:27.256480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:27.258188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 333/666] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:27 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:27.264109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:27.479691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761788fc-8f84-4b17-b6ac-d6946d63ad0f None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:27.534500 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:27.535225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:27.535514 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:27.535792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:27.536530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] RBAC: Adding query filter params (name=network) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:27.536839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:27.538232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a64fd-d9be-4bc5-88e3-3f767cca0208 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:27.544118 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 334/667] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:27.551095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:27.605127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:27.728697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bffe7-cfbc-4732-8a99-a5d925b660f4 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:27.806665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:27.808561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:27.809375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:27.810161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:27.811974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] RBAC: Adding query filter params (type=network) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:27.812898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:27.815923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de777637-94e0-40b7-b0ec-173bcae53aab None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:27.831301 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 334/668] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:28.265878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e450-ca73-4577-a5f3-9cb7eaaecb8f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:28.267733 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e450-ca73-4577-a5f3-9cb7eaaecb8f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:28.268655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e450-ca73-4577-a5f3-9cb7eaaecb8f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:28.272089 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 335/669] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:28.283533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a00ff-e220-49b8-b4b3-4d1d986a4046 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:28.285348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a00ff-e220-49b8-b4b3-4d1d986a4046 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:28.286132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a00ff-e220-49b8-b4b3-4d1d986a4046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:28.320533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5e1a00ff-e220-49b8-b4b3-4d1d986a4046 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:28.323465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5e1a00ff-e220-49b8-b4b3-4d1d986a4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:28.481050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 335/670] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:28.527694 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e450-ca73-4577-a5f3-9cb7eaaecb8f None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:28.572853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:28.743985 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e450-ca73-4577-a5f3-9cb7eaaecb8f None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:28.816343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a916c-c909-46ca-bcab-b1a475dc11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:28.817427 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a916c-c909-46ca-bcab-b1a475dc11fd None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:28.817958 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a916c-c909-46ca-bcab-b1a475dc11fd None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:28.818468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a916c-c909-46ca-bcab-b1a475dc11fd None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:28.819741 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a916c-c909-46ca-bcab-b1a475dc11fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:28.822469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a916c-c909-46ca-bcab-b1a475dc11fd None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:28.852641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 336/671] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:25:28 2022] POST /identity/v3/services => generated 242 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:25:29.487249 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a544f3-5458-430a-91cb-926d2eca1f89 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:29.488104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a544f3-5458-430a-91cb-926d2eca1f89 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:29.488264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a544f3-5458-430a-91cb-926d2eca1f89 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:29.491451 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 336/672] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:29.501386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd964a-137a-431f-8bea-fc8828e9bbdf None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:29.502627 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd964a-137a-431f-8bea-fc8828e9bbdf None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:29.503176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd964a-137a-431f-8bea-fc8828e9bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:29.533118 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-3efd964a-137a-431f-8bea-fc8828e9bbdf None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:29.535428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-3efd964a-137a-431f-8bea-fc8828e9bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:29.698690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 337/673] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:29 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:29.751819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a544f3-5458-430a-91cb-926d2eca1f89 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:29.836018 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:29.983438 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a544f3-5458-430a-91cb-926d2eca1f89 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:30.059861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801eaf2-d6e4-4ecb-b225-45677fcc607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:30.060789 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801eaf2-d6e4-4ecb-b225-45677fcc607d None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:30.061272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801eaf2-d6e4-4ecb-b225-45677fcc607d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:30.061760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801eaf2-d6e4-4ecb-b225-45677fcc607d None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:30.063183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801eaf2-d6e4-4ecb-b225-45677fcc607d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:30.065791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801eaf2-d6e4-4ecb-b225-45677fcc607d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:30.099209 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 337/674] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:25:29 2022] POST /identity/v3/services => generated 251 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:25:30.185017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4ae2-c8a4-421c-9123-13b0160db271 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:30.185326 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4ae2-c8a4-421c-9123-13b0160db271 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:30.185590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4ae2-c8a4-421c-9123-13b0160db271 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:30.187618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 338/675] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:30.195179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:30.195694 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:30.196196 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:30.229170 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:30.231380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:30.370746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 338/676] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:30 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:30.414812 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4ae2-c8a4-421c-9123-13b0160db271 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:30.432315 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:30.629739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4ae2-c8a4-421c-9123-13b0160db271 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:30.700008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:30.701349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:30.701840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:30.702323 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:30.724177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:30.740445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:30.742253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:30.743628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 339/677] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:30.753440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:30.811768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:30.976452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dbe80-d3a8-4668-a3d8-3711d433fb64 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:31.019299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:31.019992 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.020276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.020549 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.021341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:31.021720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:31.023326 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff394af-a192-437c-b928-7079d52ed3f0 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:31.034577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 339/678] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:31.043675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:31.191457 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:31.260310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8999b-d9da-41ee-9dce-e5ef7e21620d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:31.304942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d46cb7-9435-401c-be18-fddcbaf5b4a9 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.305393 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d46cb7-9435-401c-be18-fddcbaf5b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.305780 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d46cb7-9435-401c-be18-fddcbaf5b4a9 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.311215 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 340/679] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:31.314121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.314575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.314917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.333584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:31.334938 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.335535 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.335708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:31.335941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.337328 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:31.359049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:31.362619 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:31.400704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:31.403525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:31.405545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:31.405545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:31.405545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:31.405545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:31.405545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 340/680] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:31.412904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:31.437098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 341/681] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:31 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 14:25:31.468891 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:31.492598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:31.618684 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dc1a5-6578-460d-ac93-e8179ebbc007 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:31.650631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:31.675666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:31.676671 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.677334 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.677797 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.678727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:31.678889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ff90b-3b68-41bf-8783-514bf2a505c3 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:31.679404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:31.681019 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:31.697707 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 341/682] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:31.707569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:31.753256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:31.754523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.755157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.755519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.756867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:31.760432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:31.799814 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 342/683] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:25:31 2022] POST /identity/v3/services => generated 240 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:25:31.890646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddca94-9dc8-48da-a5b8-a2456fc964bb None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:31.977464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:31.979043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:31.979530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:31.980021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:31.995920 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:31.998751 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:32.027866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:32.028898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:32.030655 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 342/684] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jul 14 14:25:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:32.036995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:32.182353 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:32.236247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c0f19-55af-4088-aebf-757672cb028d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:32.302640 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:32.303834 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:32.304307 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:32.304797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:32.306473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:32.307018 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:32.309790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:32.345299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 343/685] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jul 14 14:25:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:32.354745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:32.418903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:32.559696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe652-f5ff-402a-9186-ecb1bf23f5b0 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:32.609214 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:32.611051 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:32.611665 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:32.612185 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:32.624388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:32.627263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:32.650160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:32.651657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:32.652554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:32.652554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:32.652554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:32.652554 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:32.655144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 343/686] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:32.664085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:32.886559 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310b24-03c5-45a8-a5fd-0c01b47c061f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:32.960884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:32.972309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:32.973440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:32.973939 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:32.974404 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:32.976029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:32.976566 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:32.979259 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8b761-bafc-4253-ab56-b8294897bc3b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:33.000729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 344/687] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:33.011901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:33.201153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:33.230777 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1c5a0-a72e-4711-8ae1-81cc3dd1a556 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.231325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1c5a0-a72e-4711-8ae1-81cc3dd1a556 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.231821 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1c5a0-a72e-4711-8ae1-81cc3dd1a556 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.237930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22086c-c08b-4943-a3fa-5b0a4df314d2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:33.241310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 345/688] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:33.243804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.244313 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.245023 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.279547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:33.281579 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:33.317688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:33.319540 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.320043 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.320531 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.338366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:33.341824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:33.375316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:33.377461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:33.378367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:33.379393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 344/689] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:33.388716 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:33.447110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 346/690] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:33.493434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:33.612889 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4fd6-1798-46c1-ae24-e7027e204ff4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:33.680249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:33.681353 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.681841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.682001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.683253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:33.683775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:33.685591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b65e5-ce79-4dd9-994f-c9128d514cf7 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:33.686320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ef8b-6f45-4278-8209-1a20a53ab1d3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:33.718853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 345/691] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:33.718853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bb1e-04ad-4aa6-89fd-13dbfc83e272 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.718853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bb1e-04ad-4aa6-89fd-13dbfc83e272 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.718853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bb1e-04ad-4aa6-89fd-13dbfc83e272 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.718853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 346/692] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:33.721389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bb1e-04ad-4aa6-89fd-13dbfc83e272 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:33.732972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:33.745981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:33.771602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:33.772651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.773061 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.773517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] PATH_INFO: `/v3/services/image` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.774336 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:33.776123 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-efeb4c9b-97f3-4673-a83c-d372d4d9331a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:33.796818 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:33.800094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:33.801895 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:33.806896 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 347/693] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Jul 14 14:25:33 2022] GET /identity/v3/services/image => generated 86 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:33.808604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:33.809006 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:33.809372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:33.837284 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:33.839029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:33.935727 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 348/694] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:33.938887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:33.952253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bb1e-04ad-4aa6-89fd-13dbfc83e272 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.010581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.012803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.013641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.014482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/a69be22bfe524d48a0f2932f83694f5a/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.020237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=a69be22bfe524d48a0f2932f83694f5a, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.023060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.042807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 347/695] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:25:33 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/a69be22bfe524d48a0f2932f83694f5a/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:25:34.043319 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.124240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631171-09dc-4413-8e6f-4a66c6092e6a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.167297 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.179870 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.231648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.232351 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.232646 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.232901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.233654 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] RBAC: Adding query filter params (name=image) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:34.233962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.236062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.240963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89acc2-bba1-45a6-abde-494ecee61ea6 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.247579 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 349/696] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:34.249383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.306788 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.307633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.307919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.308197 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.308887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.310327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:34.326238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:34.329338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:34.332209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:34.335464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 348/697] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:34.335464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.480185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615e3b-c292-4aed-8673-adbc35d8572c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.493176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950f1b6-61f6-4038-9911-b41b59897450 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.532396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.537964 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.538778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.539235 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.539706 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.541060 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:34.541238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.542771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.554170 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 349/698] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:34.555755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.557077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.558489 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.559236 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.559947 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.561560 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] RBAC: Adding query filter params (type=image) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:34.562331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.566146 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.577240 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 350/699] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:34.584053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.676190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.751277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aab71-62c0-49a7-99b0-3fe276234a8f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.767791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcfe4a-6329-4ba9-b175-e02244db952f None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:34.813581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.814583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.815233 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.815710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.816668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:34.817179 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.818826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.826037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 350/700] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:34.833338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.843004 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:34.844021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:34.845022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:34.845516 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:34.846556 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] RBAC: Adding query filter params (interface=public, service_id=296c8de627c74282ac3b6b6b92c0edb4, region_id=RegionOne) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:34.847144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:34.848782 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:34.863434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 351/701] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/endpoints?service_id=296c8de627c74282ac3b6b6b92c0edb4&interface=public®ion_id=RegionOne => generated 194 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:34.865837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:34.944384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:35.032942 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c448b0-d526-4970-ae1d-35402517a7d6 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:35.060321 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e71ac6-2d3f-4a42-82dc-e2fae430dfb3 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:35.083373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:35.104366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:35.105547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.105972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.106436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.107578 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] RBAC: Adding query filter params (interface=public, service_id=4c0513ed80fb4f05b5f288c5f81b4c6c, region_id=RegionOne) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:35.108313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:35.111520 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e73e4-fc81-4826-b954-a65b475f9728 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:35.119423 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc374b-3f63-4899-a685-44da452acf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:35.120116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc374b-3f63-4899-a685-44da452acf22 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.120407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc374b-3f63-4899-a685-44da452acf22 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.120684 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc374b-3f63-4899-a685-44da452acf22 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.121409 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc374b-3f63-4899-a685-44da452acf22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:35.122886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc374b-3f63-4899-a685-44da452acf22 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:35.123866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 351/702] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/endpoints?service_id=4c0513ed80fb4f05b5f288c5f81b4c6c&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:35.127571 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0a058-cfce-45bc-ba0a-98d26977b3b0 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.128064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0a058-cfce-45bc-ba0a-98d26977b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.128561 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0a058-cfce-45bc-ba0a-98d26977b3b0 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.131339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 352/703] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:35.133688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0a058-cfce-45bc-ba0a-98d26977b3b0 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:35.139577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 352/704] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:25:34 2022] GET /identity/v3/services => generated 1002 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:25:35.142080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.142080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.142490 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.163137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:35.164474 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:35.262741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 353/705] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:35.303694 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:35.364932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0a058-cfce-45bc-ba0a-98d26977b3b0 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:35.412839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:35.445592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:35.446762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.447097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.447380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.448092 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:35.449521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:35.457539 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 353/706] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:25:35 2022] GET /identity/v3/services => generated 1002 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:25:35.523768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f518304-c249-4c4e-af90-be5f9446179b None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:35.526476 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:35.602027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:35.603493 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.603990 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.604486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] PATH_INFO: `/v3/services/network` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.605781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:35.608568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:35.634875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:35.636109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:35.637005 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:35.638417 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 354/707] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:35 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:35.654408 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:35.856788 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5334340-ad02-45f0-b83c-b5e2eb0bd7d3 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:35.930781 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:35.931907 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:35.932394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:35.932885 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:35.934258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:35.934826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:35.937676 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:35.948585 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 354/708] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:35.955171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:36.163731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf9451-b9ef-41fe-883e-b2cf5820adf6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:36.233356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:36.234477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:36.235000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:36.236012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:36.237311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] RBAC: Adding query filter params (type=network) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:36.237854 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:36.240564 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:36.251615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 355/709] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:36.257721 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:36.369188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:36.437490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b336e-6b86-45dc-86d4-dc5e69db65d2 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:36.481271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:36.481954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:36.482238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:36.482517 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:36.483434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] RBAC: Adding query filter params (interface=public, service_id=eeb4575dcc30465a81d9923c63fddb56, region_id=RegionOne) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:36.483691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:36.485134 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc3d39-977f-4cf3-80b7-175911a07ccd None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:36.492201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 355/710] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:25:36 2022] GET /identity/v3/endpoints?service_id=eeb4575dcc30465a81d9923c63fddb56&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:36.497903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:36.541208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:36.635603 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b600e-f629-41df-b188-a451fffc2b0a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:36.681588 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48828bcd-541f-4b20-aa16-8a264d89ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:36.682741 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828bcd-541f-4b20-aa16-8a264d89ad5a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:36.683294 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828bcd-541f-4b20-aa16-8a264d89ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:36.683794 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828bcd-541f-4b20-aa16-8a264d89ad5a None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:36.684697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828bcd-541f-4b20-aa16-8a264d89ad5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:36.686463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828bcd-541f-4b20-aa16-8a264d89ad5a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:36.696125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 356/711] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:25:36 2022] GET /identity/v3/services => generated 1002 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:25:37.728646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e7a18-9ca1-4b5d-a2a2-6d5fb663f149 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:37.729420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e7a18-9ca1-4b5d-a2a2-6d5fb663f149 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:37.729420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e7a18-9ca1-4b5d-a2a2-6d5fb663f149 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:37.731006 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 356/712] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:37.740617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:37.742102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:37.742873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:37.775603 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:37.778017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:37.904646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad991-ea30-4068-b01e-4b29bad9f88e None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:37.905108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad991-ea30-4068-b01e-4b29bad9f88e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:37.905552 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad991-ea30-4068-b01e-4b29bad9f88e None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:37.909208 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 357/713] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:37.914842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:37.915536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:37.915714 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:37.917198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 357/714] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:37.935593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:37.936863 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:37.962062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.012264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.026800 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 358/715] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:25:38.055926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.114607 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.166210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d79d6-ac6b-4b40-884b-3dd9fb6e3ad8 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:38.185016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99354-2d36-4e8b-ad27-1b9d40091dd7 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:38.232913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:38.234027 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.234471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.235522 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] PATH_INFO: `/v3/services/image` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.236519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:38.238161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:38.238559 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:38.240007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.240575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.241234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:38.253888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:38.255004 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 14:25:38.255878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:38.263227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:25:38.263722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 359/716] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:38.264817 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:25:38.273247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:38.274375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:25:38.275388 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:38.280244 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 358/717] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:38.281531 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.382338 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.401304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ac46-352a-4b52-8546-eedce0a60f9d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:38.409302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3e7b1-353f-40de-a6e2-8c0336dc7e1e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:38.422014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.445680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:38.446463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.446824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.447197 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.448298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:38.448448 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:38.449920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a77b-f9fe-4f03-907e-601c76c96016 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:38.459176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:38.460192 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.460670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.461163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.462087 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:38.466599 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 359/718] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:38.467131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:38.468309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f08b4-3c71-4729-9de3-12a6102467d9 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.468695 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f08b4-3c71-4729-9de3-12a6102467d9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.469042 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f08b4-3c71-4729-9de3-12a6102467d9 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.469494 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f0e4-5c70-428c-b034-b3966cb054b5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:38.471336 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 360/719] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:38.472222 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f08b4-3c71-4729-9de3-12a6102467d9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.483288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 360/720] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:38.486899 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.487433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.487917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.518469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:38.520688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:38.623293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 361/721] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:38.624002 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.670541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f08b4-3c71-4729-9de3-12a6102467d9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:38.742433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:38.743898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.744389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.745049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.768943 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:38.770429 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c674360-965a-4595-84b0-0b1ffb3a3ef0 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:38.771608 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:38.772427 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.788112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:38.813720 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:38.815852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:38.817982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:38.817982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:38.817982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:38.817982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:38.823867 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 361/722] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:38.825378 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.830101 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:38.831611 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:38.832076 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:38.833564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:38.834836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] RBAC: Adding query filter params (type=image) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:38.835380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:38.837830 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:38.846551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 362/723] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:38.848168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:38.999357 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136c78-255f-48bd-90fc-bc3b7977bc3c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.015327 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cbedd-86ea-4f8f-bad7-47388e9ebc44 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.050926 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.052031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.052509 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.053038 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.053876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.055969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.065682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.066358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.066635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.066907 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.067702 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:39.068005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.069396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:39.073227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:39.075125 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 14:25:39.076810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:39.083203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 362/724] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:39.084487 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.088331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 363/725] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:39.089163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.125576 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:39.185286 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:39.237277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6bf0-7fcc-4263-ac00-880a1dd2dd0f None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.245889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6767c0a-43d4-48c6-afbb-306e9ced0a6c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.284581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.285512 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.286411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.286411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.287483 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:39.288003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.289768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.296636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 364/726] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jul 14 14:25:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:39.298528 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.299222 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.299501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.299850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.300550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.302049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.304274 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.332645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 363/727] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:25:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:25:39.334600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.515409 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:39.538450 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f92ff-7cdf-46b4-9ae1-64c5e1d838c3 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.584087 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53713958-eb3a-46c8-b54f-b057e6252fb8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.605632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.607076 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.607832 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.608045 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.612373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:39.621733 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.624362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:25:39.653434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:39.654565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 14:25:39.655949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:39.659069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 365/728] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jul 14 14:25:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:39.662406 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.663464 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.663967 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.664468 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.665695 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:39.666173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.667660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.668031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.676100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 364/729] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jul 14 14:25:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:39.690356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.875489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3801-ab36-45b0-aaeb-32f3e9767fdf None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.894682 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599858b1-a39d-4bb3-8f56-2ce59aa25752 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:39.927255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.927949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.928232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.928526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.929390 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:39.929698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.931270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2ccf-a9d6-43f3-9000-2d52eab11f71 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.952675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120afa9c-19e6-4b1d-96ea-3367d2166105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:39.954287 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120afa9c-19e6-4b1d-96ea-3367d2166105 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.954761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120afa9c-19e6-4b1d-96ea-3367d2166105 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.955254 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120afa9c-19e6-4b1d-96ea-3367d2166105 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.956548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120afa9c-19e6-4b1d-96ea-3367d2166105 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:39.958743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120afa9c-19e6-4b1d-96ea-3367d2166105 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:39.968243 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 366/730] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jul 14 14:25:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:39.968243 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b418-3166-4211-afd5-d8308dcff285 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.968243 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b418-3166-4211-afd5-d8308dcff285 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.968243 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b418-3166-4211-afd5-d8308dcff285 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.972422 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 367/731] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:39.973390 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b418-3166-4211-afd5-d8308dcff285 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:39.988633 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 365/732] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:25:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:25:39.989979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:39.990281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:39.990546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:39.999298 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:40.012969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:40.014260 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:40.057969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:40.169718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 366/733] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:39 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:40.198281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:40.199362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b418-3166-4211-afd5-d8308dcff285 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:40.264735 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:40.265845 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:40.266391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:40.266891 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:40.397965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94adcb-5ade-41c0-9d9a-43b8684b16d3 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:40.403643 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:40.408178 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:40.434590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:40.488121 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:40.488946 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:40.489233 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:40.489519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:40.490207 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:40.491791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:40.506008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:40.508028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:40.509925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 367/734] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:40 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:40.513871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:40.571972 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:40.653510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 368/735] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:39 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:40.661490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:40.725052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50116-809d-44d4-a5ed-746c7b1c08d4 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:40.794426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:40.796110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:40.796923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:40.798373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:40.800000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:40.800805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:40.804012 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:40.815400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 368/736] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:40.820683 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:40.829837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9348af-6cf9-4dc4-96d2-1e28d83f4dc0 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:40.860902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:40.907782 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:40.908750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:40.908922 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:40.909296 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:40.922955 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:40.924515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:40.948332 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:40.950014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:40.952363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:40.952363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:40.952363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:40.952363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:40.955482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 369/737] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:40.957769 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:41.018933 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:41.038110 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71dac8-5d27-4dcf-b411-49deae2901c8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:41.101492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:41.102829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.103623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.104172 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.105651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] RBAC: Adding query filter params (type=network) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:41.106324 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:41.109230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:41.127602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 369/738] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:41.130511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:41.153047 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27498-c6e5-449f-b61d-9506b2b58616 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:41.225717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:41.226420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.226703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.226967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.227748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:41.228190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:41.229584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:41.251739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 370/739] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:41.253612 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:41.279788 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:41.353305 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f08c-3855-4252-a1f6-1fc2837d9bc3 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:41.400105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:41.400886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.401185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.401466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.402271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:41.404000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:41.433861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a32b3-8874-4741-bb0c-44c878b2ba64 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:41.435499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 370/740] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:25:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:25:41.503584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:41.504460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.504747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.505022 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.514059 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:41.515636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:41.535990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:41.536986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:41.537926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 371/741] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:41.544575 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:41.558211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:41.683144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812401-2cea-4914-ac30-37964d91d7ee None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:41.729342 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:41.730036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.730318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.730595 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.731448 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:41.731758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:41.733249 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344752b4-4b63-4c0a-8da5-7fc289c653e9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:41.752501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 371/742] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:41.759015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:41.877061 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:41.905601 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee03cae-09d2-4ac3-bce5-a583fb8ae38b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:41.956888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:41.957604 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:41.957889 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:41.958127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:41.959005 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=a69be22bfe524d48a0f2932f83694f5a) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:41.959329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:41.960894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22851f73-fb08-4dce-a035-517c0a4982f9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:41.974209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 372/743] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:25:41 2022] GET /identity/v3/role_assignments?user.id=a69be22bfe524d48a0f2932f83694f5a&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:42.921166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c60ab-c23d-4f83-aea2-ee0f1dee86c3 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.921774 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c60ab-c23d-4f83-aea2-ee0f1dee86c3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.922283 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c60ab-c23d-4f83-aea2-ee0f1dee86c3 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.925649 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 372/744] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:42.934688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a752b7-0221-493e-bfc5-48f2f14ae1b2 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:42.935229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a752b7-0221-493e-bfc5-48f2f14ae1b2 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:42.935726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a752b7-0221-493e-bfc5-48f2f14ae1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:42.967155 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-94a752b7-0221-493e-bfc5-48f2f14ae1b2 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:42.969401 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-94a752b7-0221-493e-bfc5-48f2f14ae1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:43.111474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 373/745] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:42 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:43.127542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15376eb9-7f5a-4d32-916c-d4209a0f8e21 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.128003 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15376eb9-7f5a-4d32-916c-d4209a0f8e21 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.128411 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15376eb9-7f5a-4d32-916c-d4209a0f8e21 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.130107 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 373/746] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:43.136329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.136791 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.137217 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.154265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15376eb9-7f5a-4d32-916c-d4209a0f8e21 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:43.157749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:43.159239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:43.267974 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:43.277085 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 374/747] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:43 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:25:43.305117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:43.312893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:43.383838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15376eb9-7f5a-4d32-916c-d4209a0f8e21 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:43.453098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cd0c8-9a22-4202-83fa-6b0cdf8748da None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:43.462745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:43.464366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.465116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.465902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.513201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:43.514652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.515872 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.516876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.518156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:43.520473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:43.542787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:43.544999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:43.546660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 375/748] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:43.554149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:43.615367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:43.617890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:43.681455 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:43.716521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:43.759418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917427-38c0-4494-bf9c-958481e487f4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:43.783176 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 374/749] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:25:43 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:43.788523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:43.833519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:43.835030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:43.835750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:43.836544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:43.838258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:43.839116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:43.842419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:43.852937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 376/750] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:43.863757 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:43.972033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1629d-ad01-446f-9f37-8aaa42721ca5 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:44.043310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deaaa1-57f1-4bef-8267-4329fe2508f4 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:44.048479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:44.049877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:44.050440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:44.050921 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:44.067947 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:44.070234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:25:44.094838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:44.096663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:44.097989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:25:44.097989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:25:44.097989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:25:44.097989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:44.097989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 375/751] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:44.100713 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:44.106520 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:44.114696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:44.115992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:44.116391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:44.116888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:44.118450 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:44.118801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:44.121658 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6970fa3-8820-4b65-a0a5-ee72019958a8 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:44.131594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 377/752] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:44.138050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:44.256816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417449d-01ea-4c02-a3a0-60d80b7f638a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:44.304715 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:44.305290 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:44.305577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:44.305856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:44.306617 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:44.306925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:44.308879 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5094d-df73-4e01-9de4-dffc21f3b60c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:44.325179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 376/753] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:44.880403 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f90cf5-360c-419a-8783-5ea9bd042304 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:44.880792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f90cf5-360c-419a-8783-5ea9bd042304 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:44.881145 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f90cf5-360c-419a-8783-5ea9bd042304 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:44.882627 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 378/754] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:44.888667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:44.888956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:44.889233 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:44.908779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:44.910013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:44.992866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 377/755] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:44 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:45.018237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f90cf5-360c-419a-8783-5ea9bd042304 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:45.208740 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f90cf5-360c-419a-8783-5ea9bd042304 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:45.258329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:45.259335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:45.259726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:45.260093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:45.260953 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:45.262458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:45.277440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:45.279625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:45.280795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 379/756] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Jul 14 14:25:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:45.289068 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:45.304550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:45.422171 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac2ff-3909-40bc-9c04-b3e45e4ad3e9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:45.473915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:45.474606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:45.474885 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:45.475260 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:45.475993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:45.476300 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:45.477708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d188d-bfa8-4a07-b419-266420094f24 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:45.484056 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 378/757] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jul 14 14:25:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:45.490367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:45.565545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:45.629814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597976-f7cc-4c3b-ab6f-f677acb9eb43 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:45.704864 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:45.706066 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:45.706560 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:45.707107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:45.708542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:45.709096 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:45.711870 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75885ed1-5c4e-4b81-8d69-1b4aa761c92e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:45.721464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 380/758] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jul 14 14:25:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:46.973075 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04994a-1ec3-40ee-a30a-b20054cc4979 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:46.973671 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04994a-1ec3-40ee-a30a-b20054cc4979 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:46.974122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04994a-1ec3-40ee-a30a-b20054cc4979 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:46.976725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 379/759] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:46.985802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7e859-6ba0-4d05-b05e-c76fecc50bfb None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:46.986605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7e859-6ba0-4d05-b05e-c76fecc50bfb None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:46.986869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7e859-6ba0-4d05-b05e-c76fecc50bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:47.006846 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-e0e7e859-6ba0-4d05-b05e-c76fecc50bfb None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:47.008159 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-e0e7e859-6ba0-4d05-b05e-c76fecc50bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:47.099000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 381/760] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:46 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:47.124877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04994a-1ec3-40ee-a30a-b20054cc4979 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:47.291890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:47.325534 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04994a-1ec3-40ee-a30a-b20054cc4979 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:47.369693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe72a-4172-4ce0-8ffc-c6fcc4d5a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:47.370373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe72a-4172-4ce0-8ffc-c6fcc4d5a6a7 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:47.370660 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe72a-4172-4ce0-8ffc-c6fcc4d5a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:47.370942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe72a-4172-4ce0-8ffc-c6fcc4d5a6a7 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:47.371735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe72a-4172-4ce0-8ffc-c6fcc4d5a6a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:47.373162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe72a-4172-4ce0-8ffc-c6fcc4d5a6a7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:47.388900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 380/761] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:25:47 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:25:48.192191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f863aa-ba55-4fb4-a0dd-be66d710cdc8 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:48.192784 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f863aa-ba55-4fb4-a0dd-be66d710cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:48.193156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f863aa-ba55-4fb4-a0dd-be66d710cdc8 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:48.195889 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 382/762] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:48.204889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041c9c3-8900-4b00-bf7c-4d0d21001ba6 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:48.205644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041c9c3-8900-4b00-bf7c-4d0d21001ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:48.205644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041c9c3-8900-4b00-bf7c-4d0d21001ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:48.224347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-b041c9c3-8900-4b00-bf7c-4d0d21001ba6 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:48.225611 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-b041c9c3-8900-4b00-bf7c-4d0d21001ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:48.319054 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 381/763] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:48 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:25:48.363234 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f863aa-ba55-4fb4-a0dd-be66d710cdc8 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:48.430722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:48.509856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f863aa-ba55-4fb4-a0dd-be66d710cdc8 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:48.557245 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f746c-1c7c-422f-9643-b755c89106ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:48.557926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f746c-1c7c-422f-9643-b755c89106ae None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:48.558211 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f746c-1c7c-422f-9643-b755c89106ae None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:48.558493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f746c-1c7c-422f-9643-b755c89106ae None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:48.559269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f746c-1c7c-422f-9643-b755c89106ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:48.560686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f746c-1c7c-422f-9643-b755c89106ae None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:48.585058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 383/764] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:25:48 2022] POST /identity/v3/services => generated 269 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:25:49.969735 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06fc1a-9c4e-4b1c-b09b-003f21333571 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:49.970335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06fc1a-9c4e-4b1c-b09b-003f21333571 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:49.970335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06fc1a-9c4e-4b1c-b09b-003f21333571 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:49.972010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 382/765] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:49.977904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:49.978479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:49.978479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:49.997969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:49.999246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:50.095542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 384/766] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:49 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:50.122053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06fc1a-9c4e-4b1c-b09b-003f21333571 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:50.236971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:50.317547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06fc1a-9c4e-4b1c-b09b-003f21333571 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:50.383996 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:50.385232 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:50.385702 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:50.386177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:50.387380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:50.389504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:50.412623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:50.414644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:50.421462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 383/767] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:50.423571 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:50.469039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:50.570262 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a43a-f783-4b46-bef6-832ce8e7eb8c None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:50.743983 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:50.744674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:50.744953 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:50.745233 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:50.745961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:50.746262 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:50.747831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:50.753928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 385/768] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:50.760290 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:50.887876 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8307-651a-4a79-846a-aeabf49f55fe None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:50.920322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:50.934024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:50.934825 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:50.935243 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:50.935609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:50.936438 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:50.936834 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:50.939021 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:50.945185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 384/769] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:50.952221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:51.143969 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:51.150089 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657466c4-54d8-4faf-b9d5-fff3f100e02c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:51.194727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:51.195576 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:51.195941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:51.196302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:51.197224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] RBAC: Adding query filter params (interface=public, service_id=9495102619084b1d9df8aee215a958aa, region_id=RegionOne) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:51.197625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:51.199249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813da63-c903-495d-87bd-d8720a9bec3b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:51.206686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 386/770] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:25:50 2022] GET /identity/v3/endpoints?service_id=9495102619084b1d9df8aee215a958aa&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:51.213422 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:51.215816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef6889-5654-4580-9562-6020af9e648d None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:51.216103 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef6889-5654-4580-9562-6020af9e648d None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:51.216379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef6889-5654-4580-9562-6020af9e648d None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:51.217904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 387/771] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:25:51.226082 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:51.227271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:51.227652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:51.253413 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:51.255425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:51.361794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 388/772] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:25:51.369408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b886c7-37df-4bf2-97ae-3378a8537a33 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:51.387645 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:51.416749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:51.417447 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:51.417799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:51.418141 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:51.419157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:51.420691 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:51.428609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 385/773] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:25:51 2022] GET /identity/v3/services => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:25:51.538098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:51.548602 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7743c0-8569-4995-95d9-d7e8467c9c98 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:51.593169 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:51.594961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:51.594961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:51.595497 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:51.595902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:51.597429 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:51.612058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:51.614130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:51.615941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 389/774] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Jul 14 14:25:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:51.620875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:51.703261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:51.803261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f5595-48de-4319-ac10-f863e745816e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:51.869732 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:51.870527 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:51.870913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:51.871379 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:51.872274 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:51.872673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:51.874227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:51.881040 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 386/775] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jul 14 14:25:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:51.887418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:52.022608 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27bd1-dac2-413a-9288-8e7ed4ec453e None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:52.062857 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:52.063661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:52.064007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:52.064416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:52.065225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:52.065590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:52.067090 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:52.074469 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 390/776] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jul 14 14:25:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:52.081044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:52.211865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b68f2-03e2-4d09-a75d-182b82706989 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:52.250805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:52.274229 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:52.274790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:52.275106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:52.275379 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:52.276394 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] RBAC: Adding query filter params (interface=public, service_id=bfbe623251244e8b9cdfc3e96ad568f9, region_id=RegionOne) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:52.276700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:52.278104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e3da-9388-42e8-956d-111ab7c5ec62 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:52.286796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 387/777] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:25:52 2022] GET /identity/v3/endpoints?service_id=bfbe623251244e8b9cdfc3e96ad568f9&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:52.296284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:52.354475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:52.503413 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee1e6-9bb3-47de-a692-18418cdcd915 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:52.545921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ed55-6b50-4dad-b41b-65d7d12923cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:52.546492 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ed55-6b50-4dad-b41b-65d7d12923cd None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:52.546941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ed55-6b50-4dad-b41b-65d7d12923cd None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:52.547135 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ed55-6b50-4dad-b41b-65d7d12923cd None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:52.548113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8ed55-6b50-4dad-b41b-65d7d12923cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:52.549479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8ed55-6b50-4dad-b41b-65d7d12923cd None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:52.556430 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 391/778] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:25:52 2022] GET /identity/v3/services => generated 1498 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:25:54.011029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174daa89-ea0c-4926-8205-8aba58ff4e1a None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:54.011924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174daa89-ea0c-4926-8205-8aba58ff4e1a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:54.011924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174daa89-ea0c-4926-8205-8aba58ff4e1a None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:54.013927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 388/779] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:54.020832 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:54.021391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:54.022011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:54.052893 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:54.055118 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:54.170396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 392/780] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:54 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:54.198946 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174daa89-ea0c-4926-8205-8aba58ff4e1a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:54.395931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174daa89-ea0c-4926-8205-8aba58ff4e1a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:54.463335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978c98-5146-4790-82dd-96973775deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:54.464704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978c98-5146-4790-82dd-96973775deaa None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:54.465180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978c98-5146-4790-82dd-96973775deaa None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:54.465671 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978c98-5146-4790-82dd-96973775deaa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:54.466938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02978c98-5146-4790-82dd-96973775deaa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:54.470150 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02978c98-5146-4790-82dd-96973775deaa None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-02978c98-5146-4790-82dd-96973775deaa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:54.494304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:54.495786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 14:25:54.496672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:54.497523 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 389/781] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:54.506460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:54.528446 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:54.636461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c01d-8c31-4992-b50c-da8b8a36ee2e None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:54.681280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:54.681861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:54.682174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:54.682631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:54.683415 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:54.683765 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:54.685228 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:54.691791 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 393/782] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:54.697844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978c98-5146-4790-82dd-96973775deaa None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:54.775235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:54.853886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978c98-5146-4790-82dd-96973775deaa None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:54.896060 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:54.896743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:54.897024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:54.897304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:54.898027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:54.898479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:54.899894 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd3273-cf77-49d3-9a48-0786268bf3df None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:54.906017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 390/783] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jul 14 14:25:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:54.913465 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:55.068370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:55.095748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ed9b0-bb9d-4519-b1f6-1e731b5ee8b3 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:55.137634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928ddc7-feb8-468c-8d47-95256cc94aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:55.138308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ddc7-feb8-468c-8d47-95256cc94aeb None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:55.138584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ddc7-feb8-468c-8d47-95256cc94aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:55.138856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ddc7-feb8-468c-8d47-95256cc94aeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:55.139654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928ddc7-feb8-468c-8d47-95256cc94aeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:55.141775 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928ddc7-feb8-468c-8d47-95256cc94aeb None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:55.167405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 394/784] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:25:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:25:55.276656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735c37-7b23-45a5-a2ea-004b17856ad0 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:55.277573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735c37-7b23-45a5-a2ea-004b17856ad0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:55.277573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735c37-7b23-45a5-a2ea-004b17856ad0 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:55.279428 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 391/785] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:55.286200 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:55.286488 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:55.286769 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:55.307459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:55.308783 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:55.412074 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 395/786] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:55 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:55.440725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735c37-7b23-45a5-a2ea-004b17856ad0 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:55.573624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735c37-7b23-45a5-a2ea-004b17856ad0 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:55.584745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:55.615584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:55.616428 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:55.616707 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:55.616981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:55.617669 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:55.619126 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:55.632862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:55.634156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:55.635746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 392/787] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Jul 14 14:25:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:55.644602 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:55.721254 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:55.772008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45705db-2478-400b-b927-dec0a89abaa1 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:55.821586 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:55.822720 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:55.823248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:55.823726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:55.825028 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:55.825568 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:55.828156 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:55.838366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 396/788] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jul 14 14:25:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:55.844881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:55.966364 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b5153-3aa7-4482-aadd-17e37779e3d7 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:56.009683 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:56.010368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:56.010656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:56.010938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:56.011700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:56.012015 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:56.013466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30785d24-e101-4078-9996-cde927bb34a1 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:56.020533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 393/789] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jul 14 14:25:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:56.027318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:56.152674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1d949-eac2-4370-9ba6-17c32486a01d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:56.186800 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:56.199062 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6062-f44e-4a15-ba81-1f0acee9ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:56.199865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6062-f44e-4a15-ba81-1f0acee9ec7f None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:56.200263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6062-f44e-4a15-ba81-1f0acee9ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:56.200635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6062-f44e-4a15-ba81-1f0acee9ec7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:56.201510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6062-f44e-4a15-ba81-1f0acee9ec7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:56.203039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6062-f44e-4a15-ba81-1f0acee9ec7f None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:56.226172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 397/790] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:25:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:25:58.005870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca436-08d7-4383-8097-018d1b1df001 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:58.006459 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca436-08d7-4383-8097-018d1b1df001 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:58.006856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca436-08d7-4383-8097-018d1b1df001 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:58.009520 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 394/791] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:58.019739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b67d38-ce73-4416-8471-e19873323013 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:58.020314 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b67d38-ce73-4416-8471-e19873323013 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:58.020752 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b67d38-ce73-4416-8471-e19873323013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:58.046116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-98b67d38-ce73-4416-8471-e19873323013 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:58.047956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-98b67d38-ce73-4416-8471-e19873323013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:58.138903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 398/792] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:58 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:58.168241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca436-08d7-4383-8097-018d1b1df001 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:58.235232 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:58.323542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca436-08d7-4383-8097-018d1b1df001 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:58.378893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:58.379656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:58.379975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:58.380293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:58.381061 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:58.382598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:58.385094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING keystone.server.flask.common [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 14:25:58.412354 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.sql.core [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 14:25:58.412354 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 14:25:58.412354 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [parameters: {'id': '31d762b762c54a3983e642b3f57520d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 14:25:58.412354 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87185) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31d762b762c54a3983e642b3f57520d9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31d762b762c54a3983e642b3f57520d9. Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:25:58.447483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result.read() Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 14:25:58.449032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application yield resource Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise self.value Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application session.commit() Jul 14 14:25:58.450035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.session.flush() Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application compat.raise_( Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:25:58.451208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 14:25:58.453938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result.read() Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:25:58.455804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [parameters: {'id': '31d762b762c54a3983e642b3f57520d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:58.457980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:58.460046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31d762b762c54a3983e642b3f57520d9. Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:25:58.462029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 395/793] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Jul 14 14:25:58 2022] POST /identity/v3/projects => generated 262 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:58.463329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b67d38-ce73-4416-8471-e19873323013 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:58.605420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b67d38-ce73-4416-8471-e19873323013 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:58.618518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:58.666654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:58.668367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:58.668872 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:58.669420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:58.683952 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:58.685948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-73843d7c-3207-49c3-a631-99f1af7c40d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:25:58.710771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:58.712357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:58.714157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 399/794] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:25:58.722857 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:58.863229 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:58.877747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0283571-360f-4531-a9fc-6131bd12fd43 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:58.933619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:58.934481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:58.934833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:58.935212 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:58.936246 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:58.936626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:58.939234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e8d43-9e88-4ace-8e68-0dc8d49da46f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:58.966936 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 396/795] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:25:59.147738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec49e-94f8-4f1d-a743-229ab1c61e6f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:59.148525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec49e-94f8-4f1d-a743-229ab1c61e6f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:59.148525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec49e-94f8-4f1d-a743-229ab1c61e6f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:59.149828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 400/796] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:25:59.159348 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:59.160180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:59.160180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:59.189277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:25:59.191868 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:25:59.301318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 397/797] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:25:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:25:59.326934 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec49e-94f8-4f1d-a743-229ab1c61e6f None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:59.536690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec49e-94f8-4f1d-a743-229ab1c61e6f None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:59.614801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:59.616221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:59.616700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:59.617184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:59.618423 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:59.621143 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:25:59.638629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:25:59.640632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:25:59.643023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 401/798] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:25:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:25:59.651403 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:25:59.809310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:59.850030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887642c-d3d7-42f4-a56a-e18dd2d4e27e None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:25:59.920192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:25:59.921393 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:25:59.921910 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:25:59.923180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:25:59.924588 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:25:59.925157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:25:59.927972 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e85fa-45ed-4b53-a047-6455a5224c8f None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:25:59.943879 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 398/799] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:25:59.945848 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:00.011865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:00.142261 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ef3f-a11a-4781-b79c-4334481fe095 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:00.192041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:00.193070 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:00.193070 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:00.193362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:00.194097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] RBAC: Adding query filter params (type=compute) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:00.194435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:00.195972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ecfd-fea8-4e56-a898-27cf937f2c7e None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:00.201848 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 402/800] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:25:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:01.670755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ee24f-b546-43f4-8713-fcad92925454 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:01.671621 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ee24f-b546-43f4-8713-fcad92925454 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:01.671760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ee24f-b546-43f4-8713-fcad92925454 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:01.673402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 399/801] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:26:01.681592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:01.682392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:01.682392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:01.701823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:01.703194 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:01.798368 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 403/802] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:26:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:26:01.827917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ee24f-b546-43f4-8713-fcad92925454 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:02.023280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ee24f-b546-43f4-8713-fcad92925454 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:02.087387 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:02.088477 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:02.088974 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:02.089459 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:02.090806 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:02.093492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:02.115120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.sql.core [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 14:26:02.115120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 14:26:02.115120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [parameters: {'user_id': '255de53152754dddabb97928b0eac8d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 14:26:02.115120 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87185) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result.read() Jul 14 14:26:02.130281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:26:02.131444 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application yield resource Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application next(self.gen) Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise self.value Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application session.commit() Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 14:26:02.132495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.session.flush() Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application compat.raise_( Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:26:02.133771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:26:02.134810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application conn.query(q) Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application result.read() Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:26:02.135851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [parameters: {'user_id': '255de53152754dddabb97928b0eac8d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:26:02.136724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 14:26:02.137551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:02.138620 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 400/803] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jul 14 14:26:01 2022] POST /identity/v3/users => generated 160 bytes in 306 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:26:02.143272 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:02.179636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:02.303221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab16305-692c-48e7-8617-346de2e197d9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:02.347867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:02.348953 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:02.349382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:02.349761 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:02.359147 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:02.361146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-6adf3773-417a-4f66-9c8b-d419a6b1fc0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:26:02.379293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:26:02.380366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 14:26:02.381341 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:26:02.383365 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 404/804] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:26:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:26:02.387664 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:02.403137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:02.649848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0e54d-28c2-4978-8938-2d979001f502 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:02.694831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:02.695906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:02.695906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:02.696199 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:02.696880 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:02.697181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:02.698826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8fcd-0c0c-4087-8568-43142b782eb4 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:02.745568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 401/805] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jul 14 14:26:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:02.811995 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac86b05-1f6d-49b6-afc6-04cc85ec7822 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:02.813353 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac86b05-1f6d-49b6-afc6-04cc85ec7822 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:02.813598 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac86b05-1f6d-49b6-afc6-04cc85ec7822 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:02.816819 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 405/806] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:26:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:02.826381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efeff-6fd1-4b74-99d6-654a9ad05a41 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:02.826784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efeff-6fd1-4b74-99d6-654a9ad05a41 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:02.827238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52efeff-6fd1-4b74-99d6-654a9ad05a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:02.857196 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-b52efeff-6fd1-4b74-99d6-654a9ad05a41 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:02.860257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-b52efeff-6fd1-4b74-99d6-654a9ad05a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:02.970471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:02.982714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 402/807] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:26:02 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:26:03.016410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac86b05-1f6d-49b6-afc6-04cc85ec7822 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:03.131431 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:03.150689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac86b05-1f6d-49b6-afc6-04cc85ec7822 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:03.193380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245526d-d1a1-49d6-b566-31defa833459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:03.194056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245526d-d1a1-49d6-b566-31defa833459 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:03.194340 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245526d-d1a1-49d6-b566-31defa833459 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:03.194618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245526d-d1a1-49d6-b566-31defa833459 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:03.195395 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245526d-d1a1-49d6-b566-31defa833459 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:03.196795 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245526d-d1a1-49d6-b566-31defa833459 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:03.213897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 406/808] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:26:03 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:26:05.638885 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39c85-cd9c-4826-8fd4-82e6acc81d63 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:05.639714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39c85-cd9c-4826-8fd4-82e6acc81d63 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:05.639714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39c85-cd9c-4826-8fd4-82e6acc81d63 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:05.640985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 403/809] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:26:05.647187 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:05.647724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:05.647834 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:05.675260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:05.676490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:05.784899 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 407/810] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:26:05 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:26:05.815347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39c85-cd9c-4826-8fd4-82e6acc81d63 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:05.944832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39c85-cd9c-4826-8fd4-82e6acc81d63 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:05.987976 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:05.988782 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:05.989066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:05.989341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:05.990019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:05.991762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:26:06.005434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:26:06.006729 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:26:06.007745 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 404/811] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:26:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:26:06.018887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:06.111709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:06.147367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625ffe4-a88f-4cb6-8983-196266486113 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:06.190188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:06.190867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:06.191260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:06.191558 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:06.192292 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:06.192637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:06.194049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:06.199897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 408/812] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:26:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:06.210608 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:06.302220 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:06.355638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441d5df-7080-4404-9284-64e2863bb4ee None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:06.398781 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:06.399640 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:06.400056 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:06.400389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:06.401373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:06.401768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:06.403407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:06.409488 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 405/813] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:26:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:06.418522 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:06.535999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc97a70-a291-4f82-a400-8672e8be0d89 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:06.577229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:06.577904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:06.578191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:06.579016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:06.579839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] RBAC: Adding query filter params (interface=public, service_id=f43ea2af600944c397472e2db229465f, region_id=RegionOne) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:06.580147 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:06.581552 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590747-eda3-4a35-a7c0-3bfe558bb667 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:06.584691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:06.591579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 409/814] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:26:06 2022] GET /identity/v3/endpoints?service_id=f43ea2af600944c397472e2db229465f&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:06.598083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:06.742122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56eb11-99ed-496b-9949-3d6daf65f4b2 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:06.780872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:06.794891 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5e6b-cefa-416f-897a-0e835c936fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:06.795743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5e6b-cefa-416f-897a-0e835c936fff None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:06.796031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5e6b-cefa-416f-897a-0e835c936fff None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:06.796312 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5e6b-cefa-416f-897a-0e835c936fff None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:06.797025 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb5e6b-cefa-416f-897a-0e835c936fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:06.799413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb5e6b-cefa-416f-897a-0e835c936fff None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:06.806838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 406/815] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:26:06 2022] GET /identity/v3/services => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:26:09.285869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d40a-a7a8-45ba-8535-7c03673ef557 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:09.286593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d40a-a7a8-45ba-8535-7c03673ef557 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:09.286593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d40a-a7a8-45ba-8535-7c03673ef557 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:09.287853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 410/816] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:26:09.294032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:09.294578 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:09.294578 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:09.313317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:26:09.314799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:26:09.413991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 407/817] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:26:09 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:26:09.444686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d40a-a7a8-45ba-8535-7c03673ef557 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:09.570444 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d40a-a7a8-45ba-8535-7c03673ef557 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:09.613989 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:09.614807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:09.615131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:09.615411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:09.616086 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:09.617484 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:26:09.631068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:26:09.632978 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:26:09.634948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 411/818] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:26:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:26:09.641917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:09.763907 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ba5ec-b670-449f-ad5f-d5fa6cdf520c None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:09.785656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:09.806731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:09.807453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:09.807737 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:09.808008 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:09.808742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:09.809050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:09.810473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:09.817584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 408/819] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:26:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:09.824163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:09.904391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:09.952713 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a4c9-5617-4065-ae51-c193b7428919 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:09.996209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:09.996883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:09.997163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:09.997436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:09.998190 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] RBAC: Adding query filter params (type=compute) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:26:09.998580 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:10.000048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2dc98-6995-4f42-aec2-1a7eaf47c21a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:10.006352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 412/820] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jul 14 14:26:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:26:10.012665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:26:10.133473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427acaf-93c2-4ae7-b519-d9935c9be043 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:26:10.199658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3739e7-21bb-4155-bc26-8db1622e6206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:26:10.200786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3739e7-21bb-4155-bc26-8db1622e6206 None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:26:10.201276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3739e7-21bb-4155-bc26-8db1622e6206 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:26:10.201765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3739e7-21bb-4155-bc26-8db1622e6206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:26:10.204305 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3739e7-21bb-4155-bc26-8db1622e6206 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:26:10.206773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3739e7-21bb-4155-bc26-8db1622e6206 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:26:10.239683 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 409/821] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:26:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:26:20.003447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=36 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:20.229955 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:18.807956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83e6a0-7c20-499a-9441-7bd720dfcf70 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:18.808546 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83e6a0-7c20-499a-9441-7bd720dfcf70 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:18.808965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83e6a0-7c20-499a-9441-7bd720dfcf70 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:18.811467 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 413/822] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:18.818083 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:18.818870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:18.818870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:18.847280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:18.849127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:18.957092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 410/823] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:18.990544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83e6a0-7c20-499a-9441-7bd720dfcf70 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:19.149771 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83e6a0-7c20-499a-9441-7bd720dfcf70 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:19.202704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:19.203618 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:19.203890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:19.204878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:19.223947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:19.225631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:19.259897 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:19.261132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:19.262111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:19.262111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:19.262111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:19.262111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:19.271032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 414/824] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:19.274872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:19.479950 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9275-f15a-4523-a996-8bfcf10c05cf None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:19.531344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:19.546165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:19.546890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:19.547257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:19.547581 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:19.549293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:19.549834 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:19.551896 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1db4bf-9756-49a9-bb7f-1e81b2496fdb None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:19.569112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 411/825] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:19.577710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:19.731553 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:19.821070 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78fab7-9781-4cdd-9092-638789c9de89 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:19.889364 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1628382-93e5-4a92-8d97-796d924c1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:19.890049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1628382-93e5-4a92-8d97-796d924c1eba None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:19.890404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1628382-93e5-4a92-8d97-796d924c1eba None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:19.890625 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1628382-93e5-4a92-8d97-796d924c1eba None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:19.891388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1628382-93e5-4a92-8d97-796d924c1eba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:19.893662 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1628382-93e5-4a92-8d97-796d924c1eba None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:19.919310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 415/826] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jul 14 14:27:19 2022] POST /identity/v3/users => generated 251 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:27:23.270751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6586-eca4-4c25-ba3e-9e182ad3bae9 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:23.271609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6586-eca4-4c25-ba3e-9e182ad3bae9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:23.271609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6586-eca4-4c25-ba3e-9e182ad3bae9 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:23.272863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 412/827] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:23.280106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:23.281003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:23.281003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:23.318216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:23.320970 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:23.469138 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 416/828] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:23 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:23.497292 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6586-eca4-4c25-ba3e-9e182ad3bae9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:23.671623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6586-eca4-4c25-ba3e-9e182ad3bae9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:23.724883 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:23.726195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:23.726591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:23.726965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:23.745596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:27:23.758161 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:23.760367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:23.761303 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 413/829] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:23.768802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:23.833153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:23.933513 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f3d1-abfe-47c4-8643-0c3a47963d30 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:23.997481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:23.998184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:23.998515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:23.998838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:23.999873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:24.000219 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:24.003019 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:24.016229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 417/830] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:24.024239 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:24.107341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:24.201482 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd19f-b562-482b-9ddf-021a88ff605b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:24.262252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:24.263244 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:24.263611 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:24.264092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:24.280454 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:24.282061 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:24.313032 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:24.316185 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:24.317940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:24.317940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:24.317940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:24.317940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:24.317940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 414/831] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:24.324503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:24.475659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:24.479597 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a528b-575e-4117-837f-35f21b21ac08 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:24.539837 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:24.540999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:24.542434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:24.543083 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:24.544591 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:24.545149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:24.547471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:24.578934 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 418/832] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:24.581370 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:24.747697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:24.754210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ebe2-9807-4e94-91e0-1f0524d8ad3d None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:24.811697 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:24.812655 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:24.812982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:24.813299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:24.825868 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:24.828011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:27:24.849347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:24.851733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:24.853753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 415/833] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:24.859485 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:25.049853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078ce9-d335-4d79-a52c-3c95440e796d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:25.121108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:25.122273 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:25.122762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:25.123313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:25.124945 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:25.125490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:25.129575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:25.159645 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 419/834] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jul 14 14:27:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:25.166606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:25.323296 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c36d-ac74-47a6-84b2-31e132c65f52 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:25.381074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:25.382217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:25.382641 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:25.382959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:25.428658 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:25.484553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:25.486858 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:25.693583 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 416/835] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:27:25 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:27:25.695020 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:25.725068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:25.881343 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a4f0-92d2-4459-9c36-1a7926a11a39 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:25.953271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:25.955277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:25.955780 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:25.956253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:25.976906 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:25.978778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:26.002439 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:26.012387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:26.014348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:26.014348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:26.014348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:26.014348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:26.014348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 420/836] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:26.014918 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:26.125602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:26.199383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3560ac1-3893-4160-bb6c-695abf528869 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:26.259537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:26.260665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:26.261105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:26.261492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:26.262767 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:26.263208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:26.264819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:26.283264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 417/837] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:26.289533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:26.409732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:26.464109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9f76a-8f61-4836-8e29-06178c03192d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:26.526476 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:26.527320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:26.527641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:26.527919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:26.535758 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:26.537282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:27:26.555762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:26.557654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:26.559629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 421/838] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:26.565964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:26.696685 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc51e-e8ef-45fb-958c-b263ecb15964 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:26.720437 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:26.748989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:26.749673 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:26.749957 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:26.750245 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:26.751180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:26.751501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:26.753207 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4572-9c41-4ba0-a1ae-fa7b5f3c435d None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:26.768981 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 418/839] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:26.776073 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:26.941986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661a651-c88e-437e-866c-f7e2fa4b639b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:26.990629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:27.000410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:27.000990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:27.002258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:27.002258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:27.003436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=e5b6927509e6432cb18a2aa7136ee98d) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:27.003886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:27.005379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850024-ce86-4cee-8ca4-91fc1eab07c4 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:27.013935 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 422/840] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:27:26 2022] GET /identity/v3/role_assignments?user.id=e5b6927509e6432cb18a2aa7136ee98d&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:29.714896 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35845-a854-4642-8d29-891ef9a5207d None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:29.715900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35845-a854-4642-8d29-891ef9a5207d None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:29.715900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35845-a854-4642-8d29-891ef9a5207d None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:29.717343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 419/841] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:29.725521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:29.726426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:29.726592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:29.750810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:29.752986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:29.872526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 423/842] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:29.905363 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35845-a854-4642-8d29-891ef9a5207d None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:30.034875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35845-a854-4642-8d29-891ef9a5207d None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:30.097034 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:30.098229 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:30.098703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:30.099180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:30.117904 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:27:30.130616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:30.132517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:30.134959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 420/843] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:27:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:30.140165 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:30.327211 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719fda9-64b3-49f5-b2e6-deba34a7fb18 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:30.384550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:30.406917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:30.408815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:30.409268 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:30.409643 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:30.410942 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:30.411353 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:30.413852 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:30.439985 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 424/844] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:27:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:30.441474 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:30.500026 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:30.588893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3046-097c-4161-b9f9-1487804f40ca None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:30.655776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:30.657299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:30.658455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:30.658965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:30.676205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:30.677855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:30.705063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:30.707069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:30.709036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:30.709036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:30.709036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:30.709036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:30.709036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 421/845] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:30.715876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:30.906382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2abbc-8f59-45e8-8263-307ab0f6d5b7 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:30.954645 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:30.955728 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:30.956070 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:30.956473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:30.957509 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:30.957777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:30.959459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:30.977253 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 425/846] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:30.983261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:31.122459 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:31.136578 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6bf1-f8a1-494d-95d7-05088045330c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:31.187723 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:31.188460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:31.189347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:31.189716 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:31.203554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:31.208166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:27:31.228074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:31.229988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:31.231993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 422/847] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:31.239089 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:31.317957 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:31.403442 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65085dc-373e-463b-96a3-25b9f7a6d411 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:31.457260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:31.458201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:31.458619 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:31.459032 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:31.460398 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:31.460836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:31.463301 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:31.491386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 426/848] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jul 14 14:27:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:31.503728 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:31.672270 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220ae3-6002-47b8-89a4-cb2f224af7b0 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:31.744302 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:31.745191 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:31.745500 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:31.745910 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:31.761082 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:31.763038 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:31.784862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:31.785999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:31.792478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:31.792478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:31.792478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:31.792478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:31.792478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 423/849] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:31.794755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:31.949157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e50d-8201-4b40-941e-ae12274f44fa None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:31.953229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:32.007176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:32.008994 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:32.009568 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:32.010167 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:32.011639 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:32.012135 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:32.014724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:32.050727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 427/850] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:32.052368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:32.056177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:32.227900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f55a3-2f5d-416d-8902-8a850d0b85d6 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:32.285140 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:32.285999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:32.286396 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:32.286887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:32.298916 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:32.301013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:27:32.317875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:32.319399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:32.321347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 424/851] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:32.325825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:32.514377 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e79d7-fbce-4867-870b-1f1cec34e912 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:32.564374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:32.565515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:32.565515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:32.566035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:32.566547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:32.566867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:32.568471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05db9a1-c7a3-4033-b468-2c719420945a None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:32.583867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 428/852] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:32.590147 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:32.694029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:32.755979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f375-4a49-4519-8e44-d913b8cf4e2e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:32.810352 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428886e2-0f93-4d4e-a806-b3a90b682cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:32.811533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428886e2-0f93-4d4e-a806-b3a90b682cfe None admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:32.811926 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428886e2-0f93-4d4e-a806-b3a90b682cfe None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:32.812372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428886e2-0f93-4d4e-a806-b3a90b682cfe None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/e5b6927509e6432cb18a2aa7136ee98d/roles/77834b1268574ab9a1fff71598d4758e` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:32.834536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428886e2-0f93-4d4e-a806-b3a90b682cfe None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=e5b6927509e6432cb18a2aa7136ee98d, role_id=77834b1268574ab9a1fff71598d4758e)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:32.835984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428886e2-0f93-4d4e-a806-b3a90b682cfe None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:32.854646 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 425/853] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:27:32 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/e5b6927509e6432cb18a2aa7136ee98d/roles/77834b1268574ab9a1fff71598d4758e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:27:35.756920 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb5d5-e47e-45de-9511-c68ec277b250 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:35.757778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb5d5-e47e-45de-9511-c68ec277b250 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:35.757967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb5d5-e47e-45de-9511-c68ec277b250 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:35.760560 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 429/854] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:35.766810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:35.768300 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:35.768300 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:35.791092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:35.792869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:35.913308 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 426/855] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:35.951230 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bb5d5-e47e-45de-9511-c68ec277b250 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:35.988034 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:36.121497 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bb5d5-e47e-45de-9511-c68ec277b250 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:36.170323 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:36.171623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:36.172171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:36.172637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:36.190339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:27:36.199157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:36.201093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:36.202793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 430/856] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jul 14 14:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:36.208023 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:36.291993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:36.407463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802bcb-2f2f-41d0-bc83-59049c617ded None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:36.475111 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:36.475962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:36.476359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:36.476908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:36.478182 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] RBAC: Adding query filter params (name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:36.479050 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:36.481071 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:36.502545 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 427/857] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jul 14 14:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:36.505851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:36.648325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:36.679884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e600b-b451-4efb-9f6e-48f16ae9323c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:36.737022 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:36.738240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:36.738711 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:36.739164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:36.755667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:36.757467 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:36.781141 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:36.783747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:36.785370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:36.785370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:36.785370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:36.785370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:36.785370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 431/858] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:36.792135 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:36.967271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6b26-7516-46b9-af36-27a9b11608da None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:36.972261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:37.023589 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:37.024572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:37.025040 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:37.025550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:37.026486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:37.026844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:37.028778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:37.049762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 428/859] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:37.057249 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:37.227015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3776a0-1110-40b3-ae09-bb4ba60a36ec None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:37.278095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:37.278924 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:37.279246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:37.279544 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:37.283616 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:37.290599 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:37.292273 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:27:37.310631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:37.312696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:37.314456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 432/860] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:37.322600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:37.499011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429bb8b-e61c-4ba6-8bcf-b39b8c2a677c None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:37.577278 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:37.578322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:37.578710 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:37.579183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:37.581570 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:37.582217 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:37.585203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:37.625498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 429/861] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jul 14 14:27:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:37.633170 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:37.819021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76fa53-5d5e-4edc-812a-a7ada29ba028 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:37.884268 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:37.885114 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:37.885468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:37.885804 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:37.991630 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:38.000466 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:38.002427 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:38.161064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 433/862] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:27:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 14:27:38.167007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:38.197080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:38.294029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadcbb9-0038-4c06-9b40-69c3f145a4e8 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:38.340417 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:38.341408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:38.341755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:38.342170 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:38.355908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:38.357907 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:38.383492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:38.384927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:38.386928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:38.386928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:38.386928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:38.386928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:38.386928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 430/863] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:38.391612 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:38.539688 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:38.550056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88be5b4-3082-404d-b197-a04071e8461d None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:38.614616 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:38.615524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:38.615902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:38.616330 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:38.617414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:38.617828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:38.620010 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:38.638171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 434/864] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:38.645159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:38.756716 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:38.793466 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbfc5-2b67-4443-9dc2-5a71e1a8bf89 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:38.845317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:38.847019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:38.847396 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:38.847908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:38.857754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:38.859948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:27:38.879099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:38.880965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:38.882843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 431/865] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:38.894186 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:39.042152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c5878-66bc-48f3-aa73-0a2523eaad54 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:39.089017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:39.089637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:39.089918 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:39.090261 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:39.091016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:39.091364 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:39.092822 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9df0b-b3a7-44f3-abcf-082b7ae4139d None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:39.108999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 435/866] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:39.116929 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:39.265656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac68f3-513c-46ef-8f37-0eb67b588fab None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:39.317593 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:39.318509 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:39.319016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:39.319455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:39.320598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] RBAC: Adding query filter params (role.id=77834b1268574ab9a1fff71598d4758e, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=e5b6927509e6432cb18a2aa7136ee98d) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:39.321031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:39.323162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791f57e-f5be-47a9-a305-07c99a395540 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:39.326260 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:39.336592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 432/867] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:27:39 2022] GET /identity/v3/role_assignments?user.id=e5b6927509e6432cb18a2aa7136ee98d&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=77834b1268574ab9a1fff71598d4758e => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:42.357338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ade00-8186-4a52-aab7-e5f502767bd8 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:42.358392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ade00-8186-4a52-aab7-e5f502767bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:42.358392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ade00-8186-4a52-aab7-e5f502767bd8 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:42.362009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 436/868] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:27:42.370227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:42.370798 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:42.371237 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:42.409825 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:42.412731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:42.572481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 433/869] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:42.603869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ade00-8186-4a52-aab7-e5f502767bd8 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:42.629016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:42.763773 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ade00-8186-4a52-aab7-e5f502767bd8 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:42.824143 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:42.825325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:42.825817 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:42.826302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:42.847109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:27:42.857468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:42.859346 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:42.861600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 437/870] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:42.868278 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:43.030463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7918ae-9a55-4fbb-b88d-82c606d788d1 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:43.075286 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:43.087873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:43.088546 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:43.088827 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:43.089103 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:43.089870 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:43.090173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:43.091605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:43.104829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 434/871] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:43.114137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:43.234570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:43.272121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078ef65-03e1-4d18-8f8a-204111ba0765 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:43.319657 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:43.320557 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:43.320923 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:43.321136 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:43.335768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:43.337254 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:43.362570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:43.365551 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:43.367691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:43.367691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:43.367691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:43.367691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:43.367691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 438/872] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:43.371748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:43.552420 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355eece-fc73-4d17-9bf3-b94f9c1765bf None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:43.610394 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:43.611799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:43.612202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:43.612504 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:43.613593 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:43.614143 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:43.616596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:43.637334 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 435/873] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:43.646111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:43.816038 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab261f3-dc9f-40c6-a6fa-9a8f59ba8dfa None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:43.861999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:43.872334 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:43.873154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:43.873433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:43.873705 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:43.883288 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:43.884789 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:27:43.913768 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:43.915565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:43.917419 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 439/874] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:43.928677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:44.042761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:44.133714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac66b-3963-4cf1-bf6d-15c591d0ee08 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:44.188619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:44.190677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:44.191198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:44.191585 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:44.192848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:44.193321 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:44.195327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:44.224447 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 436/875] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jul 14 14:27:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:44.234494 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:44.402840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72ce3-6982-470c-be0d-dd60f757a634 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:44.464023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:44.465265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:44.467027 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:44.467027 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:44.565963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:44.585610 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:44.587414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:44.747851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 440/876] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:27:44 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:27:44.756031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:44.919411 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b9900-c59b-4371-98d1-76bc8bf217ba None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:44.930997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:44.959051 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:44.959862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:44.960222 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:44.963403 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:44.977150 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:44.978892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:45.001501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:45.003865 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:45.005693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:45.005693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:45.005693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:45.005693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:45.005693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 437/877] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:45.009128 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:45.128666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:45.150724 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537621a6-32c4-4c6c-9f1c-ef838c654216 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:45.207001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:45.207845 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:45.208218 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:45.208615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:45.209475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:45.209984 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:45.212507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:45.233087 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 441/878] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:45.240569 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:45.422784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5341c61-8599-4e61-8f29-6d2b33cb163e None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:45.491046 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:45.492443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:45.492995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:45.493493 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:45.508186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:45.512844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:27:45.541860 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:45.543902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:45.546265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 438/879] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:45.551348 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:45.679182 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36174088-9994-47f8-8620-8ae5655e09ca None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:45.720510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:45.721204 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:45.721490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:45.721770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:45.722577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:45.722888 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:45.724404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c220-ed06-41dc-9713-2cf08659a058 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:45.740037 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 442/880] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:45.746454 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:45.773210 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:45.876148 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461354-58e3-492a-81f9-40ac04bcc785 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:45.918272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:45.918951 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:45.919384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:45.919672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:45.920815 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=e5b6927509e6432cb18a2aa7136ee98d) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:45.921133 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:45.922640 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5e344-d17e-4f0f-b13e-00537dbac512 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:45.939625 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 439/881] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:27:45 2022] GET /identity/v3/role_assignments?user.id=e5b6927509e6432cb18a2aa7136ee98d&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:48.394752 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78054ec-9f4d-414e-9ec8-90e550a66784 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:48.395695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78054ec-9f4d-414e-9ec8-90e550a66784 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:48.395695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78054ec-9f4d-414e-9ec8-90e550a66784 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:48.397425 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 443/882] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:48.406464 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:48.407066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:48.407066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:48.426934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:48.428795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:48.507425 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 440/883] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:48 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:48.533050 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78054ec-9f4d-414e-9ec8-90e550a66784 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:48.545186 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:48.664176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78054ec-9f4d-414e-9ec8-90e550a66784 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:48.723831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:48.725183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:48.725696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:48.726210 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:48.747099 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:27:48.755881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:48.758755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:48.759894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 444/884] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:48.764452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:48.781645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:48.889601 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148611a3-519f-4b42-a6ed-ed0dffabf89b None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:48.932277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:48.932894 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:48.933177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:48.933539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:48.934326 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:48.934738 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:48.936322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:48.946731 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 441/885] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:48.953115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:49.036683 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:49.079505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a9af1-7c79-442a-9f3e-06f839b43454 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:49.120232 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:49.121117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:49.121453 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:49.121782 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:49.134963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:49.136542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:49.156750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:49.159072 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:49.161069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:49.161069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:49.161069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:49.161069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:49.161069 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 445/886] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:49.166472 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:49.276053 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:49.305676 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf029ed2-328a-41be-a860-da3dd933ce02 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:49.346935 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:49.347648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:49.347935 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:49.348216 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:49.348971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:49.349281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:49.350713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:49.369931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 442/887] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:49.379582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:49.524323 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e33dd4-2fca-4c11-a875-bd295bda4789 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:49.549126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:49.567687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:49.568579 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:49.568865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:49.569148 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:49.578113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:49.579644 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:27:49.595803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:49.597533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:49.599698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 446/888] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:49.605589 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:49.726479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4521ba-552e-46f6-b0f6-7d36ce971276 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:49.769471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:49.770152 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:49.770436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:49.770709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:49.771614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:49.771924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:49.773398 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:49.776659 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:49.807372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 443/889] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jul 14 14:27:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:49.813059 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:49.948635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19678e41-1e84-4d69-9d62-1b20c628763b None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:50.010747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:50.012162 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:50.012653 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:50.013135 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:50.035393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:50.038172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:50.073542 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:50.074664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:50.076410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:50.076410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:50.076410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:50.076410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:50.076410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 447/890] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:50.086031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:50.218022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12fb5-b913-48aa-9c80-30eea8c4bd03 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:50.259977 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:50.260655 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:50.260942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:50.261218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:50.261959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:50.262266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:50.263718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:50.278168 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 444/891] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:50.287954 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:50.325364 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:50.416205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414328c-e926-4b3a-938d-41a820adcf22 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:50.457055 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:50.457886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:50.458168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:50.458447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:50.472082 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:50.474996 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:27:50.495623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:50.497280 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:50.499121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 448/892] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:50.508562 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:50.583632 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:50.648721 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa834-3512-4e75-bfbd-9db906f7d462 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:50.690755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:50.691500 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:50.691785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:50.692056 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:50.692868 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:50.693179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:50.694670 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1bee-dee3-4e53-8e83-d7f8b8002f35 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:50.710761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 445/893] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:50.717331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:50.835131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:50.847664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417b03d-5312-4d5a-8760-bd0f8ad82966 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:50.888489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa798b-ff96-4ac8-bb4a-1d7e9d6f02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:50.889374 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa798b-ff96-4ac8-bb4a-1d7e9d6f02f5 None admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:50.889658 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa798b-ff96-4ac8-bb4a-1d7e9d6f02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:50.889933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa798b-ff96-4ac8-bb4a-1d7e9d6f02f5 None admin] PATH_INFO: `/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/e5b6927509e6432cb18a2aa7136ee98d/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:50.892128 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa798b-ff96-4ac8-bb4a-1d7e9d6f02f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdb8d57f44342b8a29e027879d0f1d1, user_id=e5b6927509e6432cb18a2aa7136ee98d, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:50.894197 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa798b-ff96-4ac8-bb4a-1d7e9d6f02f5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:50.910013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 449/894] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jul 14 14:27:50 2022] PUT /identity/v3/projects/fcdb8d57f44342b8a29e027879d0f1d1/users/e5b6927509e6432cb18a2aa7136ee98d/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:27:53.399744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36199e5-63bd-4a99-9b35-5c6b55d7e0fc None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:53.400598 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36199e5-63bd-4a99-9b35-5c6b55d7e0fc None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:53.400902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36199e5-63bd-4a99-9b35-5c6b55d7e0fc None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:53.403848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 446/895] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:53.411604 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:53.412223 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:53.412223 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:53.436929 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:53.438403 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:53.527386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 450/896] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:27:53.554085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36199e5-63bd-4a99-9b35-5c6b55d7e0fc None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:53.676898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36199e5-63bd-4a99-9b35-5c6b55d7e0fc None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:53.695270 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:53.721644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:53.722532 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:53.722866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:53.723238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:53.735899 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 14:27:53.744651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:53.746426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:53.749471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 447/897] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jul 14 14:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:53.755679 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:53.896702 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:53.917747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cdced-8839-4bc6-9b99-765427eced3e None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:53.960121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:53.960766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:53.961090 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:53.961407 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:53.962231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:53.962581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:53.964075 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:53.974160 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 451/898] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jul 14 14:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:53.980302 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:54.101498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bdbb8-4918-4fee-8151-97ab14d85f14 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:54.144263 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:54.145067 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:54.145358 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:54.145643 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:54.158847 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:54.160343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:54.179961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:54.181850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:54.184027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:54.184027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:54.184027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:54.184027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:54.184027 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 448/899] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:54.189793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:54.311108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b74b3-7c35-4cbe-97c5-e87c9c8aec98 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:54.351666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:54.352533 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:54.352890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:54.353256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:54.354279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:54.354826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:54.356596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:54.372994 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 452/900] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:54.380363 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:54.412751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:54.502708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0b5ee-42d7-4046-be0a-7cbd9792c127 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:54.543163 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:54.544029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:54.544311 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:54.544591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:54.554970 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:54.556488 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 14:27:54.573100 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:54.574890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:54.576764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 449/901] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:54.582185 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:54.588679 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:54.704796 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314798d9-7bf7-4ea6-867a-23af92d4ce84 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:54.748276 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:54.748960 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:54.749242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:54.749516 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:54.750367 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:54.750675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:54.753214 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:54.774814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 453/902] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jul 14 14:27:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:54.781281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:54.887778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:54.905803 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255959f5-d260-4e77-ae2e-9bc91c61d891 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:54.945332 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:54.946036 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:54.946370 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:54.946693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:55.028406 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:55.029982 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:55.133816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:55.152536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 450/903] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jul 14 14:27:54 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 14:27:55.159504 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:55.231597 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:55.280102 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d3cb-ace6-4b2a-91b7-d41407dc4db9 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:55.320851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:55.321654 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:55.321936 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:55.322210 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:55.334839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:55.336359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 14:27:55.356894 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:55.358629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:55.360532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 14:27:55.360532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 14:27:55.360532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 14:27:55.360532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:55.360532 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 454/904] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:55.365498 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:55.488971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010345ae-444b-4dcb-a76d-c54f0859eab1 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:55.531665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:55.532331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:55.532613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:55.532883 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:55.534942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:55.535277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:55.536703 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:55.551066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 451/905] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jul 14 14:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:27:55.559842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:55.720505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011349e1-3ae4-4d72-8fc2-046b776251c1 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:55.741067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:55.764271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:55.765074 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:55.765349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:55.765626 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:55.774937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:55.776444 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 14:27:55.793794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:55.795589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: ERROR keystone.server.flask.application Jul 14 14:27:55.798013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 455/906] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jul 14 14:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 14:27:55.805799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:55.864786 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:55.933123 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82dcdf-8174-484f-801b-decdb2c1483b None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:55.976200 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:55.976866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:55.977151 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:55.977426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:55.978228 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:55.978539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:55.980056 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ee4a8-fb8d-431f-a6d0-9c8c7a65705c None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:55.994768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 452/907] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jul 14 14:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:56.001175 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:56.120731 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6e288-3d69-4f33-a1e8-de0c0c701296 None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:56.165152 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:56.165824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:56.166101 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:56.166373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:56.167238 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] RBAC: Adding query filter params (role.id=b54c08538cf74f1e83a40ae268cfccfa, scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1, user.id=e5b6927509e6432cb18a2aa7136ee98d) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:56.167550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:56.169000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0926757-5c9b-4d5c-b46b-1058f477abc5 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:56.177848 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 456/908] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jul 14 14:27:56 2022] GET /identity/v3/role_assignments?user.id=e5b6927509e6432cb18a2aa7136ee98d&scope.project.id=fcdb8d57f44342b8a29e027879d0f1d1&role.id=b54c08538cf74f1e83a40ae268cfccfa => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:58.662707 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814b75-549f-42a6-8387-ae66dbb89969 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:58.663592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814b75-549f-42a6-8387-ae66dbb89969 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:58.663748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814b75-549f-42a6-8387-ae66dbb89969 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:58.665441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 453/909] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:27:58.672681 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:58.673258 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:58.673681 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:58.703763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:27:58.706458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:27:58.762926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:58.808617 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 457/910] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:27:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:27:58.834885 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb814b75-549f-42a6-8387-ae66dbb89969 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:58.959491 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb814b75-549f-42a6-8387-ae66dbb89969 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:58.968192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:59.000706 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:59.001561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:59.001946 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:59.002264 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:59.002997 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:59.004495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:27:59.017769 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:27:59.019791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:27:59.021730 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 454/911] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jul 14 14:27:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:27:59.027664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:59.143908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a23b8-782d-44b7-9b49-8de4813fba30 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:59.183163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:59.183850 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:59.184132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:59.184407 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:59.185129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] RBAC: Adding query filter params (name=placement) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:59.185436 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:59.187083 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd52a7-ac9f-4fa8-b881-957ed6936b6c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:59.193556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 458/912] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jul 14 14:27:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:27:59.202587 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:27:59.318801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119724b-c59c-436b-8313-d2b7c4d22b19 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:27:59.358511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:27:59.359220 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:27:59.359522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:27:59.359784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] PATH_INFO: `/v3/services` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:27:59.360518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] RBAC: Adding query filter params (type=placement) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:27:59.361011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:27:59.363086 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad4e92-1ba1-4e9b-9d41-79495ac78bcc None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:27:59.368801 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 455/913] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jul 14 14:27:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:28:02.039970 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f372fd-99f5-4eed-82fd-aa300da23708 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:02.040539 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f372fd-99f5-4eed-82fd-aa300da23708 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:02.040925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f372fd-99f5-4eed-82fd-aa300da23708 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:02.043329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 459/914] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:28:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:28:02.050723 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65980066-88ac-4eeb-ba31-a8968414d17b None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:02.051374 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65980066-88ac-4eeb-ba31-a8968414d17b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:02.051374 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65980066-88ac-4eeb-ba31-a8968414d17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:02.072043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-65980066-88ac-4eeb-ba31-a8968414d17b None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:28:02.074157 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-65980066-88ac-4eeb-ba31-a8968414d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:28:02.111055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:02.171390 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 456/915] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:28:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:28:02.200262 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f372fd-99f5-4eed-82fd-aa300da23708 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:02.239825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:02.328838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f372fd-99f5-4eed-82fd-aa300da23708 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:02.377915 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4a85-6645-43eb-aa82-071d4d843425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:02.378898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4a85-6645-43eb-aa82-071d4d843425 None admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:02.379318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4a85-6645-43eb-aa82-071d4d843425 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:02.379605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4a85-6645-43eb-aa82-071d4d843425 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:02.380550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c4a85-6645-43eb-aa82-071d4d843425 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:02.382575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c4a85-6645-43eb-aa82-071d4d843425 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:02.412009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 460/916] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jul 14 14:28:02 2022] POST /identity/v3/services => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:28:04.878785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faa466-8a22-42d2-be9d-a7fe4b1c6746 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:04.879440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faa466-8a22-42d2-be9d-a7fe4b1c6746 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:04.879440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faa466-8a22-42d2-be9d-a7fe4b1c6746 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:04.880819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 457/917] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:28:04.886874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:04.887474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:04.887619 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:04.909411 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:28:04.910640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:28:04.996719 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 461/918] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:28:04 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 14:28:05.022852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faa466-8a22-42d2-be9d-a7fe4b1c6746 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:05.143900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faa466-8a22-42d2-be9d-a7fe4b1c6746 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:05.187344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:05.188169 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:05.188457 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:05.188734 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:05.189419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:05.191558 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:28:05.204862 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:28:05.207211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:28:05.209106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 458/919] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jul 14 14:28:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:28:05.214813 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:05.237803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:05.333438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8893c-577b-4779-8055-9a29ed38789e None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:05.373777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:05.374515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:05.374866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:05.375239 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:05.376023 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] RBAC: Adding query filter params (name=placement) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:28:05.376372 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:05.378033 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:05.384305 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 462/920] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jul 14 14:28:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:28:05.390588 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:05.425480 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:05.561614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd080e-dd29-4549-b2c9-6282aa7d467a None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:05.623218 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:05.624358 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:05.624869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:05.625368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:05.626892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] RBAC: Adding query filter params (interface=public, service_id=94e36de621184e1296d39394ffd7a8fa, region_id=RegionOne) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:28:05.628095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:05.630748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf02f-9e34-4fc5-9d16-3f88458eb45b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:05.641003 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 459/921] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jul 14 14:28:05 2022] GET /identity/v3/endpoints?service_id=94e36de621184e1296d39394ffd7a8fa&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:28:05.648431 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:05.744652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:05.766956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e940d-271b-4f32-9cf1-f4fb53e7ad3c None admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:05.808135 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ffdad-4f14-4a08-82c0-1a71b4c28ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:05.809169 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ffdad-4f14-4a08-82c0-1a71b4c28ffc None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:05.809539 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ffdad-4f14-4a08-82c0-1a71b4c28ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:05.809870 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ffdad-4f14-4a08-82c0-1a71b4c28ffc None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:05.810640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ffdad-4f14-4a08-82c0-1a71b4c28ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:05.812984 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ffdad-4f14-4a08-82c0-1a71b4c28ffc None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:05.821925 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 463/922] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jul 14 14:28:05 2022] GET /identity/v3/services => generated 1962 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:28:08.186907 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72291-5372-4a87-b24c-27b45f675ec0 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:08.187525 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72291-5372-4a87-b24c-27b45f675ec0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:08.187647 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72291-5372-4a87-b24c-27b45f675ec0 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:08.189207 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 460/923] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:28:08.195826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:08.196391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:08.196391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:08.214580 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:28:08.215919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:28:08.293521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 464/924] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:28:08 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 14:28:08.320002 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72291-5372-4a87-b24c-27b45f675ec0 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:08.437631 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:08.449630 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72291-5372-4a87-b24c-27b45f675ec0 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:08.491406 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:08.492433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:08.492623 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:08.492779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:08.493453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:08.494869 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 14:28:08.509105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 14:28:08.514571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application with Lock( Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self._enter() Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application return self.creator() Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application created_value = creator( Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: ERROR keystone.server.flask.application Jul 14 14:28:08.516202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 461/925] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jul 14 14:28:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 14:28:08.519592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:08.631861 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:08.661447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1582e-552f-47d1-b0e4-6755900ae203 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:08.702726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:08.703349 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:08.703632 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:08.703906 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] PATH_INFO: `/v3/services` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:08.704634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:28:08.704946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:08.707230 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e33ab-46cb-4b53-96d3-70035c7f06f0 None admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:08.713130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 465/926] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jul 14 14:28:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:28:08.722418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:28:08.858964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82f76-3ace-44f8-8dbb-2f21fd5a3ec9 None admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:28:08.898136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113c7d5-002f-451c-9718-fc950fc11e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:28:08.898853 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c7d5-002f-451c-9718-fc950fc11e7b None admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:28:08.899224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c7d5-002f-451c-9718-fc950fc11e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:28:08.899540 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c7d5-002f-451c-9718-fc950fc11e7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:28:08.900330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113c7d5-002f-451c-9718-fc950fc11e7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:28:08.901791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113c7d5-002f-451c-9718-fc950fc11e7b None admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:28:08.924468 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 462/927] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jul 14 14:28:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:28:18.710009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=30 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:18.919314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:18.679849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b360-16a8-4569-8200-6b25fe31f63c None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:18.680682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b360-16a8-4569-8200-6b25fe31f63c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:18.680682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b360-16a8-4569-8200-6b25fe31f63c None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:18.683051 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 466/928] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:29:18.690882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8cbd7-ab51-423c-9557-cb939e56d531 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:18.691940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8cbd7-ab51-423c-9557-cb939e56d531 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:18.691940 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8cbd7-ab51-423c-9557-cb939e56d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:18.736838 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-18b8cbd7-ab51-423c-9557-cb939e56d531 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:18.740079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-18b8cbd7-ab51-423c-9557-cb939e56d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:18.929223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 463/929] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:18.998964 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392503cf-f290-4e2f-abd1-d0c2149942ad None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:18.999497 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392503cf-f290-4e2f-abd1-d0c2149942ad None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:18.999917 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392503cf-f290-4e2f-abd1-d0c2149942ad None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:19.002138 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 467/930] 10.222.0.65 () {54 vars in 964 bytes} [Thu Jul 14 14:29:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:19.012455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52620c-1407-4a6f-973a-7e121a385859 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:19.012455 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52620c-1407-4a6f-973a-7e121a385859 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:19.012955 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52620c-1407-4a6f-973a-7e121a385859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:19.138144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-aa52620c-1407-4a6f-973a-7e121a385859 None None] MFA Rules not processed for user `22fcac88391d48e1a19591ab0ac05210`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:19.140752 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-aa52620c-1407-4a6f-973a-7e121a385859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:19.282621 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 464/931] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Jul 14 14:29:19 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:19.297842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392503cf-f290-4e2f-abd1-d0c2149942ad None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:19.323576 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392503cf-f290-4e2f-abd1-d0c2149942ad None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:19.330565 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac64c3-49f1-4ef7-a3e5-27e2fd0f9a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:19.331731 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac64c3-49f1-4ef7-a3e5-27e2fd0f9a85 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:19.332248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac64c3-49f1-4ef7-a3e5-27e2fd0f9a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:19.333414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac64c3-49f1-4ef7-a3e5-27e2fd0f9a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:19.352308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac64c3-49f1-4ef7-a3e5-27e2fd0f9a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:19.355369 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac64c3-49f1-4ef7-a3e5-27e2fd0f9a85 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:19.382500 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 468/932] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:22.485923 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518686f-f765-4f52-bcf1-78962cfe5630 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:22.486511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518686f-f765-4f52-bcf1-78962cfe5630 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:22.486926 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518686f-f765-4f52-bcf1-78962cfe5630 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:22.490221 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 465/933] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:22.498798 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21895308-7a7f-456d-9d9f-0bd06841af7e None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:22.499702 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21895308-7a7f-456d-9d9f-0bd06841af7e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:22.499906 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21895308-7a7f-456d-9d9f-0bd06841af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:22.521883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-21895308-7a7f-456d-9d9f-0bd06841af7e None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:22.523524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-21895308-7a7f-456d-9d9f-0bd06841af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:22.533517 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 469/934] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:22.576553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518686f-f765-4f52-bcf1-78962cfe5630 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:22.596445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518686f-f765-4f52-bcf1-78962cfe5630 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:22.603430 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fef6d-cf39-4356-b045-e170df343274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:22.604553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fef6d-cf39-4356-b045-e170df343274 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:22.605039 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fef6d-cf39-4356-b045-e170df343274 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:22.605519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fef6d-cf39-4356-b045-e170df343274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:22.623779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fef6d-cf39-4356-b045-e170df343274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:22.626693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fef6d-cf39-4356-b045-e170df343274 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:22.647215 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 466/935] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:25.837596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1df35-4208-42dc-a299-603961399047 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:25.838555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1df35-4208-42dc-a299-603961399047 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:25.838555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1df35-4208-42dc-a299-603961399047 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:25.841438 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 470/936] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:25.852179 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a98e1-be06-4cb5-8517-f3aa39e8eea0 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:25.853055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a98e1-be06-4cb5-8517-f3aa39e8eea0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:25.853055 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a98e1-be06-4cb5-8517-f3aa39e8eea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:25.926958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-550a98e1-be06-4cb5-8517-f3aa39e8eea0 None None] MFA Rules not processed for user `0a9f7fb5dd904c9d89b8d844683f4118`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:25.929331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-550a98e1-be06-4cb5-8517-f3aa39e8eea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:25.996294 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:26.038114 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 467/937] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:25 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:26.081427 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1df35-4208-42dc-a299-603961399047 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:26.094468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1df35-4208-42dc-a299-603961399047 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:26.099042 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6350c-79ea-421d-8ec8-fa9badacf66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:26.099851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6350c-79ea-421d-8ec8-fa9badacf66f service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:26.100191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6350c-79ea-421d-8ec8-fa9badacf66f service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:26.100529 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6350c-79ea-421d-8ec8-fa9badacf66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:26.115241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6350c-79ea-421d-8ec8-fa9badacf66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:26.119371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6350c-79ea-421d-8ec8-fa9badacf66f service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:26.140911 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 471/938] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:26 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:29:29.373342 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982ee3-f028-4470-a683-0e91d8e72b6a None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:29.374183 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982ee3-f028-4470-a683-0e91d8e72b6a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:29.374346 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982ee3-f028-4470-a683-0e91d8e72b6a None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:29.376231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 468/939] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:29:29.382342 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28b466-c663-494e-afaa-a8b191b07389 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:29.382916 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28b466-c663-494e-afaa-a8b191b07389 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:29.383041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28b466-c663-494e-afaa-a8b191b07389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:29.403290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-6d28b466-c663-494e-afaa-a8b191b07389 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:29.404556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-6d28b466-c663-494e-afaa-a8b191b07389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:29.493827 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 472/940] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:29 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:29.535678 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982ee3-f028-4470-a683-0e91d8e72b6a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:29.548113 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982ee3-f028-4470-a683-0e91d8e72b6a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:29.551975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf5be-1662-4233-896f-3bf79939510d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:29.552966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf5be-1662-4233-896f-3bf79939510d service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:29.553308 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf5be-1662-4233-896f-3bf79939510d service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:29.553709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf5be-1662-4233-896f-3bf79939510d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:29.564574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bf5be-1662-4233-896f-3bf79939510d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:29.566139 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bf5be-1662-4233-896f-3bf79939510d service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:29.579223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 469/941] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:29 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:32.948650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a3dd-d062-43e0-857d-bc5c7e5ae60e None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:32.949337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a3dd-d062-43e0-857d-bc5c7e5ae60e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:32.949582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a3dd-d062-43e0-857d-bc5c7e5ae60e None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:32.952275 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 473/942] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:32.959833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6a310-3400-474e-95c2-bc288f4e8584 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:32.960718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6a310-3400-474e-95c2-bc288f4e8584 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:32.960718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6a310-3400-474e-95c2-bc288f4e8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:32.980621 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-55f6a310-3400-474e-95c2-bc288f4e8584 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:32.981874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-55f6a310-3400-474e-95c2-bc288f4e8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:32.991542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 470/943] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:33.058703 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6519f7-435d-41ed-91ef-28be30ad7c9b None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:33.059237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6519f7-435d-41ed-91ef-28be30ad7c9b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:33.059677 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6519f7-435d-41ed-91ef-28be30ad7c9b None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:33.062833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 474/944] 10.222.0.65 () {54 vars in 964 bytes} [Thu Jul 14 14:29:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:33.072984 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947a84-a561-4ba1-9b5f-78d33f323ee7 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:33.073360 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947a84-a561-4ba1-9b5f-78d33f323ee7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:33.073706 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947a84-a561-4ba1-9b5f-78d33f323ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:33.095174 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-48947a84-a561-4ba1-9b5f-78d33f323ee7 None None] MFA Rules not processed for user `22fcac88391d48e1a19591ab0ac05210`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:33.096418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-48947a84-a561-4ba1-9b5f-78d33f323ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:33.104279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 471/945] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Jul 14 14:29:33 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:33.113990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6519f7-435d-41ed-91ef-28be30ad7c9b None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:33.127590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6519f7-435d-41ed-91ef-28be30ad7c9b None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:33.132146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad36b4-d2e0-4c1b-b904-d6aad35b9045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:33.132809 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad36b4-d2e0-4c1b-b904-d6aad35b9045 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:33.133097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad36b4-d2e0-4c1b-b904-d6aad35b9045 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:33.133392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad36b4-d2e0-4c1b-b904-d6aad35b9045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:33.148796 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad36b4-d2e0-4c1b-b904-d6aad35b9045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:33.150815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad36b4-d2e0-4c1b-b904-d6aad35b9045 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:33.164810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 475/946] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:29:36.072501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c5853-973c-488e-be2f-c8027a9e59a0 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:36.073319 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c5853-973c-488e-be2f-c8027a9e59a0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:36.073518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c5853-973c-488e-be2f-c8027a9e59a0 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:36.075129 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 472/947] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:36.082142 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5865-0320-463e-9d3e-fc9d870900c1 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:36.082730 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5865-0320-463e-9d3e-fc9d870900c1 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:36.083174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d5865-0320-463e-9d3e-fc9d870900c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:36.107287 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-ee8d5865-0320-463e-9d3e-fc9d870900c1 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:36.109287 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-ee8d5865-0320-463e-9d3e-fc9d870900c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:36.120180 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 476/948] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:36.165834 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c5853-973c-488e-be2f-c8027a9e59a0 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:36.180961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c5853-973c-488e-be2f-c8027a9e59a0 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:36.185077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450ad34-f68f-49ba-bd80-aba1393ad872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:36.185743 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450ad34-f68f-49ba-bd80-aba1393ad872 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:36.186155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450ad34-f68f-49ba-bd80-aba1393ad872 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:36.186434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450ad34-f68f-49ba-bd80-aba1393ad872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:36.201317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450ad34-f68f-49ba-bd80-aba1393ad872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:36.204076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450ad34-f68f-49ba-bd80-aba1393ad872 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:36.216774 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 473/949] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:29:39.234284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b164f-78a4-465d-b56b-d0e84bb801ea None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:39.235194 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b164f-78a4-465d-b56b-d0e84bb801ea None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:39.235194 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b164f-78a4-465d-b56b-d0e84bb801ea None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:39.237107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 477/950] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:39.244841 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69611-fcbd-4a26-867d-1c86d3ea3cd2 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:39.245442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69611-fcbd-4a26-867d-1c86d3ea3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:39.245980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69611-fcbd-4a26-867d-1c86d3ea3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:39.278111 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-17a69611-fcbd-4a26-867d-1c86d3ea3cd2 None None] MFA Rules not processed for user `0a9f7fb5dd904c9d89b8d844683f4118`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:39.280155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-17a69611-fcbd-4a26-867d-1c86d3ea3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:39.294259 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 474/951] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:39 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:39.339584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b164f-78a4-465d-b56b-d0e84bb801ea None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:39.360041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b164f-78a4-465d-b56b-d0e84bb801ea None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:39.366876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486578f-b088-4359-ab51-461f5f96bfce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:39.368046 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486578f-b088-4359-ab51-461f5f96bfce service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:39.368489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486578f-b088-4359-ab51-461f5f96bfce service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:39.368979 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486578f-b088-4359-ab51-461f5f96bfce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:39.386553 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486578f-b088-4359-ab51-461f5f96bfce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:39.389378 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486578f-b088-4359-ab51-461f5f96bfce service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:39.408876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 478/952] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:39 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:42.355436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5bd4-51ed-4b50-ae45-e27e2e909c69 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:42.356203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5bd4-51ed-4b50-ae45-e27e2e909c69 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:42.356203 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5bd4-51ed-4b50-ae45-e27e2e909c69 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:42.357429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 475/953] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:29:42.363571 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e2c2b-afc0-4185-aa0e-3b3a82b709ef None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:42.364410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e2c2b-afc0-4185-aa0e-3b3a82b709ef None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:42.364410 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e2c2b-afc0-4185-aa0e-3b3a82b709ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:42.397835 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-7d2e2c2b-afc0-4185-aa0e-3b3a82b709ef None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:42.399924 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-7d2e2c2b-afc0-4185-aa0e-3b3a82b709ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:42.414226 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 479/954] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:42.460817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f5bd4-51ed-4b50-ae45-e27e2e909c69 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:42.475817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f5bd4-51ed-4b50-ae45-e27e2e909c69 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:42.482136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915d3bb-988e-4002-967e-16c3fbb9e1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:42.483342 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915d3bb-988e-4002-967e-16c3fbb9e1ce service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:42.483855 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915d3bb-988e-4002-967e-16c3fbb9e1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:42.484355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915d3bb-988e-4002-967e-16c3fbb9e1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:42.502572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915d3bb-988e-4002-967e-16c3fbb9e1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:42.506022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915d3bb-988e-4002-967e-16c3fbb9e1ce service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:42.526063 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 476/955] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:45.174853 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f4933-fa0c-48c8-8b5f-b5f87028a9a6 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:45.175674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f4933-fa0c-48c8-8b5f-b5f87028a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:45.175674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f4933-fa0c-48c8-8b5f-b5f87028a9a6 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:45.176748 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 480/956] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:45.183531 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e3022-91df-4781-951b-1a38c59ca1b7 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:45.184607 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e3022-91df-4781-951b-1a38c59ca1b7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:45.184794 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e3022-91df-4781-951b-1a38c59ca1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:45.205280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-0a8e3022-91df-4781-951b-1a38c59ca1b7 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:45.205874 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-0a8e3022-91df-4781-951b-1a38c59ca1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:45.216573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 477/957] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:45.262129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f4933-fa0c-48c8-8b5f-b5f87028a9a6 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:45.281564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f4933-fa0c-48c8-8b5f-b5f87028a9a6 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:45.288491 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d20fe-40b5-4c78-a115-228384ceeab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:45.289689 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d20fe-40b5-4c78-a115-228384ceeab7 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:45.290199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d20fe-40b5-4c78-a115-228384ceeab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:45.290686 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d20fe-40b5-4c78-a115-228384ceeab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:45.308114 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d20fe-40b5-4c78-a115-228384ceeab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:45.310051 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d20fe-40b5-4c78-a115-228384ceeab7 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:45.322426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 481/958] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:48.750142 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3f7b3-2d95-4197-b792-709dd94c6af3 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:48.750758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3f7b3-2d95-4197-b792-709dd94c6af3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:48.750758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3f7b3-2d95-4197-b792-709dd94c6af3 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:48.752317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 478/959] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:48.758698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d24a7-7499-4c25-a7cf-c8bfda33019d None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:48.759330 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d24a7-7499-4c25-a7cf-c8bfda33019d None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:48.759457 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d24a7-7499-4c25-a7cf-c8bfda33019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:48.765971 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=71 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:48.781149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-aa6d24a7-7499-4c25-a7cf-c8bfda33019d None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:48.782464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-aa6d24a7-7499-4c25-a7cf-c8bfda33019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:48.791067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 482/960] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:48 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:48.835009 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3f7b3-2d95-4197-b792-709dd94c6af3 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:48.846597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3f7b3-2d95-4197-b792-709dd94c6af3 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:48.850692 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec920b9-19e5-4f6a-bd06-4a8a8ff71759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:48.851405 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec920b9-19e5-4f6a-bd06-4a8a8ff71759 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:48.851691 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec920b9-19e5-4f6a-bd06-4a8a8ff71759 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:48.851971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec920b9-19e5-4f6a-bd06-4a8a8ff71759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:48.862242 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec920b9-19e5-4f6a-bd06-4a8a8ff71759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:48.863995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec920b9-19e5-4f6a-bd06-4a8a8ff71759 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:48.876226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 479/961] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:48 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:54.520067 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf393e8-6a61-4274-8b93-75d4c3d6f61c None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:54.520658 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf393e8-6a61-4274-8b93-75d4c3d6f61c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:54.521036 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf393e8-6a61-4274-8b93-75d4c3d6f61c None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:54.524597 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 483/962] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:29:54.531037 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd677-7c5e-4fb8-8e03-6d1fe216fd64 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:54.531893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd677-7c5e-4fb8-8e03-6d1fe216fd64 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:54.531893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd677-7c5e-4fb8-8e03-6d1fe216fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:54.555266 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-ee4bd677-7c5e-4fb8-8e03-6d1fe216fd64 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:54.557537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-ee4bd677-7c5e-4fb8-8e03-6d1fe216fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:54.573317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 480/963] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:29:54.645854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf393e8-6a61-4274-8b93-75d4c3d6f61c None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:54.669919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf393e8-6a61-4274-8b93-75d4c3d6f61c None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:54.677736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fcc2c-c6ca-4eb2-8931-18f62953f32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:54.679230 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fcc2c-c6ca-4eb2-8931-18f62953f32c service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:54.680028 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fcc2c-c6ca-4eb2-8931-18f62953f32c service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:54.680736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fcc2c-c6ca-4eb2-8931-18f62953f32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:54.700792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fcc2c-c6ca-4eb2-8931-18f62953f32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:54.703515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fcc2c-c6ca-4eb2-8931-18f62953f32c service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:54.727375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 484/964] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:58.374483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff182b-31c9-4f8e-a011-4b377db00516 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:58.375391 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff182b-31c9-4f8e-a011-4b377db00516 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:58.375632 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff182b-31c9-4f8e-a011-4b377db00516 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:58.378652 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 481/965] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:29:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:29:58.388972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed6c79-b798-47fa-959d-809b85ee60c0 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:58.389722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed6c79-b798-47fa-959d-809b85ee60c0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:58.389940 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed6c79-b798-47fa-959d-809b85ee60c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:58.423052 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-e8ed6c79-b798-47fa-959d-809b85ee60c0 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:29:58.425223 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-e8ed6c79-b798-47fa-959d-809b85ee60c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:29:58.440541 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 485/966] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:29:58 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:29:58.503988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff182b-31c9-4f8e-a011-4b377db00516 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:29:58.511164 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=51 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:58.519979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff182b-31c9-4f8e-a011-4b377db00516 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:29:58.524707 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a2e4-4a66-4a0c-ad49-edd725e90cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:29:58.525499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a2e4-4a66-4a0c-ad49-edd725e90cdd service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:29:58.525890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a2e4-4a66-4a0c-ad49-edd725e90cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:29:58.526291 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a2e4-4a66-4a0c-ad49-edd725e90cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:29:58.537605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a2e4-4a66-4a0c-ad49-edd725e90cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:29:58.539465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a2e4-4a66-4a0c-ad49-edd725e90cdd service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:29:58.551112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 482/967] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:29:58 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:30:04.296874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd15e-599c-4330-a221-06d694fbdf3a None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:04.297459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd15e-599c-4330-a221-06d694fbdf3a None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:04.297459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd15e-599c-4330-a221-06d694fbdf3a None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:04.298810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 486/968] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:30:04.305581 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ad5d-2781-4993-9516-97123bcdc4e4 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:04.306076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ad5d-2781-4993-9516-97123bcdc4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:04.306186 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ad5d-2781-4993-9516-97123bcdc4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:04.326229 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-8a56ad5d-2781-4993-9516-97123bcdc4e4 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:04.327559 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-8a56ad5d-2781-4993-9516-97123bcdc4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:04.338518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 483/969] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:04.402606 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd15e-599c-4330-a221-06d694fbdf3a None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:04.416002 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd15e-599c-4330-a221-06d694fbdf3a None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:04.419948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825044b-d97f-4d54-bef1-ca2f2d7df927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:04.420623 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825044b-d97f-4d54-bef1-ca2f2d7df927 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:04.420910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825044b-d97f-4d54-bef1-ca2f2d7df927 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:04.421188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825044b-d97f-4d54-bef1-ca2f2d7df927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:04.433317 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825044b-d97f-4d54-bef1-ca2f2d7df927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:04.434953 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825044b-d97f-4d54-bef1-ca2f2d7df927 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:04.448342 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 487/970] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:11.485871 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b082c5-bcf4-4d65-a223-d98492880c75 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:11.487389 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b082c5-bcf4-4d65-a223-d98492880c75 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:11.488550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b082c5-bcf4-4d65-a223-d98492880c75 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:11.492816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 484/971] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:30:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:11.502545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd904055-a618-45be-a350-94a71fa958ea None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:11.504112 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd904055-a618-45be-a350-94a71fa958ea None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:11.504777 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd904055-a618-45be-a350-94a71fa958ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:11.666718 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-bd904055-a618-45be-a350-94a71fa958ea None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:11.668222 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-bd904055-a618-45be-a350-94a71fa958ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:11.762641 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 488/972] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:30:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:14.320383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=8 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:18.636839 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69850821-f6be-4220-8524-88a297a2dcd0 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:18.638382 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69850821-f6be-4220-8524-88a297a2dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:18.638878 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69850821-f6be-4220-8524-88a297a2dcd0 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:18.641593 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 485/973] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:30:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:18.653339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51cc35-edb9-4ca9-ba2e-1126c04b4154 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:18.662426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51cc35-edb9-4ca9-ba2e-1126c04b4154 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:18.670521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51cc35-edb9-4ca9-ba2e-1126c04b4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:18.718631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-0c51cc35-edb9-4ca9-ba2e-1126c04b4154 None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:18.721108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-0c51cc35-edb9-4ca9-ba2e-1126c04b4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:18.739878 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 489/974] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:30:18 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:20.884367 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2e46f-8a33-4a98-a51b-422d4d20fa1c None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:20.885177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2e46f-8a33-4a98-a51b-422d4d20fa1c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:20.885177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2e46f-8a33-4a98-a51b-422d4d20fa1c None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:20.887270 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 486/975] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:30:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:20.894270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7fa5-4a12-4442-aad4-00ac1d2ac02f None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:20.895038 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7fa5-4a12-4442-aad4-00ac1d2ac02f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:20.895329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7fa5-4a12-4442-aad4-00ac1d2ac02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:20.906886 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=60 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:20.922583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-13ab7fa5-4a12-4442-aad4-00ac1d2ac02f None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:20.923846 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-13ab7fa5-4a12-4442-aad4-00ac1d2ac02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:20.933519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 490/976] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:30:20 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:25.127104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5224545-4ba0-4bf8-8740-478e2a5ec82d None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:25.127907 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5224545-4ba0-4bf8-8740-478e2a5ec82d None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:25.128094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5224545-4ba0-4bf8-8740-478e2a5ec82d None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:25.142092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 487/977] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:25 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:25.143571 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988baef6-e5c9-4f5b-95a6-22b85d857e39 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:25.144831 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988baef6-e5c9-4f5b-95a6-22b85d857e39 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:25.145315 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988baef6-e5c9-4f5b-95a6-22b85d857e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:25.182887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-988baef6-e5c9-4f5b-95a6-22b85d857e39 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:25.185434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-988baef6-e5c9-4f5b-95a6-22b85d857e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:25.202191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 491/978] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:25.313273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9515-be4b-4655-9676-97152cb4ad87 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:25.313719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9515-be4b-4655-9676-97152cb4ad87 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:25.314262 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9515-be4b-4655-9676-97152cb4ad87 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:25.316835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 488/979] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jul 14 14:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:25.337242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7f25-d93e-4361-8694-497cfaf73f2c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:25.341675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7f25-d93e-4361-8694-497cfaf73f2c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:25.342815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7f25-d93e-4361-8694-497cfaf73f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:25.410142 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-db0e7f25-d93e-4361-8694-497cfaf73f2c None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:25.411911 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-db0e7f25-d93e-4361-8694-497cfaf73f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:25.548252 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 492/980] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jul 14 14:30:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:25.562948 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9515-be4b-4655-9676-97152cb4ad87 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:25.588591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9515-be4b-4655-9676-97152cb4ad87 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:25.597656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4cc9-78fd-4848-b0db-fdeca369d762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:25.599368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4cc9-78fd-4848-b0db-fdeca369d762 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:25.600034 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4cc9-78fd-4848-b0db-fdeca369d762 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:25.600686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4cc9-78fd-4848-b0db-fdeca369d762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:25.620013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed4cc9-78fd-4848-b0db-fdeca369d762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:25.623423 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed4cc9-78fd-4848-b0db-fdeca369d762 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:25.644206 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 489/981] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:29.182839 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a468e1-7730-4b96-8b10-e43fac96c48f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:29.184972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a468e1-7730-4b96-8b10-e43fac96c48f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:29.186670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a468e1-7730-4b96-8b10-e43fac96c48f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:29.189481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 493/982] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:29.195662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890205f-4cb7-43d8-8b56-969d4277e039 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:29.196586 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890205f-4cb7-43d8-8b56-969d4277e039 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:29.197119 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890205f-4cb7-43d8-8b56-969d4277e039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:29.219252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-1890205f-4cb7-43d8-8b56-969d4277e039 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:29.220868 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-1890205f-4cb7-43d8-8b56-969d4277e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:29.243085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 490/983] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:29.291595 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a468e1-7730-4b96-8b10-e43fac96c48f None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:29.310401 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a468e1-7730-4b96-8b10-e43fac96c48f None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:29.317048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eebd66-e1ac-41ea-b79d-ab913b7d3617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:29.317747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebd66-e1ac-41ea-b79d-ab913b7d3617 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:29.318044 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebd66-e1ac-41ea-b79d-ab913b7d3617 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:29.318328 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebd66-e1ac-41ea-b79d-ab913b7d3617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:29.329225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eebd66-e1ac-41ea-b79d-ab913b7d3617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:29.330875 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eebd66-e1ac-41ea-b79d-ab913b7d3617 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:29.357710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 494/984] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:32.817799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438dccf-dae5-4b2a-bb0b-c27714551600 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:32.818293 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438dccf-dae5-4b2a-bb0b-c27714551600 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:32.818764 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438dccf-dae5-4b2a-bb0b-c27714551600 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:32.822758 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 491/985] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:32.829171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9846-92e9-44b6-b808-5698dcd7b6ab None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:32.829171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9846-92e9-44b6-b808-5698dcd7b6ab None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:32.829171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9846-92e9-44b6-b808-5698dcd7b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:32.849634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-62ca9846-92e9-44b6-b808-5698dcd7b6ab None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:32.850896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-62ca9846-92e9-44b6-b808-5698dcd7b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:32.862199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 495/986] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:32.913151 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b1e4-a3f5-454c-ae4c-26c3efae06f9 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:32.913695 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b1e4-a3f5-454c-ae4c-26c3efae06f9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:32.914859 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b1e4-a3f5-454c-ae4c-26c3efae06f9 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:32.918031 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 492/987] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jul 14 14:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:32.928299 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dc27c-3497-432f-87de-c1f18dde77b5 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:32.928727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dc27c-3497-432f-87de-c1f18dde77b5 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:32.929231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dc27c-3497-432f-87de-c1f18dde77b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:32.989441 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-719dc27c-3497-432f-87de-c1f18dde77b5 None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:32.992428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-719dc27c-3497-432f-87de-c1f18dde77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:33.017131 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 496/988] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jul 14 14:30:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:30:33.029261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44b1e4-a3f5-454c-ae4c-26c3efae06f9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:33.050576 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44b1e4-a3f5-454c-ae4c-26c3efae06f9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:33.056805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ceda3-dc2e-43b5-a58e-e9a6fe0c75cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:33.057543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ceda3-dc2e-43b5-a58e-e9a6fe0c75cb service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:33.057927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ceda3-dc2e-43b5-a58e-e9a6fe0c75cb service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:33.058323 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ceda3-dc2e-43b5-a58e-e9a6fe0c75cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:33.069128 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ceda3-dc2e-43b5-a58e-e9a6fe0c75cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:33.071362 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ceda3-dc2e-43b5-a58e-e9a6fe0c75cb service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:33.084298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 493/989] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:36.660787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935c07b-426b-4a34-af87-97ab8792b294 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:36.661558 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935c07b-426b-4a34-af87-97ab8792b294 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:36.661558 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935c07b-426b-4a34-af87-97ab8792b294 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:36.670902 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 497/990] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:36.672815 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490936b-eff2-4839-83d5-7431faeeee46 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:36.673487 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490936b-eff2-4839-83d5-7431faeeee46 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:36.673487 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490936b-eff2-4839-83d5-7431faeeee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:36.715380 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-d490936b-eff2-4839-83d5-7431faeeee46 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:36.720357 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-d490936b-eff2-4839-83d5-7431faeeee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:36.755590 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 494/991] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:30:36.840935 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935c07b-426b-4a34-af87-97ab8792b294 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:36.915024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935c07b-426b-4a34-af87-97ab8792b294 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:36.928451 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6914b-666c-4540-9eaf-d09672a86157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:36.935039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6914b-666c-4540-9eaf-d09672a86157 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:36.935039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6914b-666c-4540-9eaf-d09672a86157 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:36.935039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6914b-666c-4540-9eaf-d09672a86157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:36.951018 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6914b-666c-4540-9eaf-d09672a86157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:36.959014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6914b-666c-4540-9eaf-d09672a86157 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:36.980536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 498/992] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:40.478339 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2a51-45ac-4962-8f2d-38532953d026 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:40.479058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2a51-45ac-4962-8f2d-38532953d026 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:40.479058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2a51-45ac-4962-8f2d-38532953d026 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:40.488359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 495/993] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:40.492915 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9c18e-becc-4afe-af28-cb5489d606d2 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:40.493717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9c18e-becc-4afe-af28-cb5489d606d2 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:40.493900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9c18e-becc-4afe-af28-cb5489d606d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:40.573174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-00d9c18e-becc-4afe-af28-cb5489d606d2 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:40.576406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-00d9c18e-becc-4afe-af28-cb5489d606d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:40.594900 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 499/994] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:41.184719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309cc15-2590-4f01-b1cc-9a750bdd6815 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:41.185188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309cc15-2590-4f01-b1cc-9a750bdd6815 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:41.185664 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309cc15-2590-4f01-b1cc-9a750bdd6815 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:41.189014 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 496/995] 10.222.0.65 () {54 vars in 963 bytes} [Thu Jul 14 14:30:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:41.199214 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:41.200701 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:41.201329 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:41.296184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] MFA Rules not processed for user `ef8b686560994350b28cd4c6016b4fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:41.298584 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:41.323572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc43e8-b72f-4cc7-b448-3ad7a5eb0532 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:41.327040 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc43e8-b72f-4cc7-b448-3ad7a5eb0532 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:41.327040 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc43e8-b72f-4cc7-b448-3ad7a5eb0532 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:41.328384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 497/996] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:41.338819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:41.339822 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:41.340534 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:41.395612 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:41.399167 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:41.424211 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 498/997] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:41.486709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:41.502458 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 500/998] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Jul 14 14:30:41 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:41.505142 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27ee85-beb5-4a5f-800c-fc02385c91e4 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:41.512377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f33b5-d247-4211-81ea-8e85c7778236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:41.513440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f33b5-d247-4211-81ea-8e85c7778236 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:41.513947 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f33b5-d247-4211-81ea-8e85c7778236 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:41.514481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f33b5-d247-4211-81ea-8e85c7778236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:41.518889 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:41.525773 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f33b5-d247-4211-81ea-8e85c7778236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:41.527971 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f33b5-d247-4211-81ea-8e85c7778236 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:41.530420 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=100 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:41.543953 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 499/999] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:41.546302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda429-fd79-426c-beca-a47f1c2ee705 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:41.562752 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184205-6190-458d-9ded-06e8a992f314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8b686560994350b28cd4c6016b4fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:41.564213 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184205-6190-458d-9ded-06e8a992f314 service cinder] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:41.564550 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184205-6190-458d-9ded-06e8a992f314 service cinder] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:41.564952 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184205-6190-458d-9ded-06e8a992f314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:41.582418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184205-6190-458d-9ded-06e8a992f314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:41.584093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184205-6190-458d-9ded-06e8a992f314 service cinder] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:41.597369 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 501/1000] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:44.207787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091757c-5011-4570-b136-f99eddce91f0 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:44.208510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091757c-5011-4570-b136-f99eddce91f0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:44.208510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091757c-5011-4570-b136-f99eddce91f0 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:44.209836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 500/1001] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:44.216879 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18198c32-192f-4ad4-857e-1bfbd6d46424 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:44.217323 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18198c32-192f-4ad4-857e-1bfbd6d46424 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:44.217435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18198c32-192f-4ad4-857e-1bfbd6d46424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:44.251673 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-18198c32-192f-4ad4-857e-1bfbd6d46424 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:44.253912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-18198c32-192f-4ad4-857e-1bfbd6d46424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:44.267044 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 502/1002] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:44.327903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091757c-5011-4570-b136-f99eddce91f0 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:44.348353 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091757c-5011-4570-b136-f99eddce91f0 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:44.360489 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bec53-e865-4082-9437-75ba7f508af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:44.361626 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bec53-e865-4082-9437-75ba7f508af4 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:44.362558 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bec53-e865-4082-9437-75ba7f508af4 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:44.362790 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bec53-e865-4082-9437-75ba7f508af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:44.385272 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bec53-e865-4082-9437-75ba7f508af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:44.393840 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bec53-e865-4082-9437-75ba7f508af4 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:44.428847 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 501/1003] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:47.404418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb566e-8470-4c2e-9c34-394d7a9b9837 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:47.405199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb566e-8470-4c2e-9c34-394d7a9b9837 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:47.405199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb566e-8470-4c2e-9c34-394d7a9b9837 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:47.406284 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 503/1004] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:47.415628 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e04b5-c69a-4185-a9df-6f85532b9eb0 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:47.416666 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e04b5-c69a-4185-a9df-6f85532b9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:47.417164 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e04b5-c69a-4185-a9df-6f85532b9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:47.453978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-a50e04b5-c69a-4185-a9df-6f85532b9eb0 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:47.456280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a50e04b5-c69a-4185-a9df-6f85532b9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:47.472700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 502/1005] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:47.521233 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb566e-8470-4c2e-9c34-394d7a9b9837 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:47.538338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb566e-8470-4c2e-9c34-394d7a9b9837 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:47.545590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5027e9-aefd-4fb9-a1f9-529d10f49104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:47.546268 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5027e9-aefd-4fb9-a1f9-529d10f49104 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:47.546572 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5027e9-aefd-4fb9-a1f9-529d10f49104 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:47.546823 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5027e9-aefd-4fb9-a1f9-529d10f49104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:47.558223 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5027e9-aefd-4fb9-a1f9-529d10f49104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:47.559926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5027e9-aefd-4fb9-a1f9-529d10f49104 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:47.572696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 504/1006] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:50.832033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3b36b-c3bd-48a3-b92a-64cbf72f7458 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:50.832725 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3b36b-c3bd-48a3-b92a-64cbf72f7458 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:50.832919 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3b36b-c3bd-48a3-b92a-64cbf72f7458 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:50.835592 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 503/1007] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:50.844961 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127fb2c-88cb-43a5-ad8d-8e546c9ce702 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:50.845573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127fb2c-88cb-43a5-ad8d-8e546c9ce702 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:50.845805 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127fb2c-88cb-43a5-ad8d-8e546c9ce702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:50.871421 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-3127fb2c-88cb-43a5-ad8d-8e546c9ce702 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:50.872662 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-3127fb2c-88cb-43a5-ad8d-8e546c9ce702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:50.881302 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 505/1008] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:50.935224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3b36b-c3bd-48a3-b92a-64cbf72f7458 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:50.952839 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3b36b-c3bd-48a3-b92a-64cbf72f7458 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:50.958852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c600e4-9067-415a-a9fa-bd911704e99a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:50.959804 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c600e4-9067-415a-a9fa-bd911704e99a service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:50.960375 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c600e4-9067-415a-a9fa-bd911704e99a service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:50.960962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c600e4-9067-415a-a9fa-bd911704e99a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:50.973165 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c600e4-9067-415a-a9fa-bd911704e99a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:50.975721 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c600e4-9067-415a-a9fa-bd911704e99a service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:50.989959 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 504/1009] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:53.775910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8da0f9-787a-406b-9960-2c1de91fed8e None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:53.776677 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8da0f9-787a-406b-9960-2c1de91fed8e None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:53.777339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8da0f9-787a-406b-9960-2c1de91fed8e None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:53.781084 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 506/1010] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:53.787309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aad85-be76-4f0d-bdae-b8f4e4cd122a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:53.788289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aad85-be76-4f0d-bdae-b8f4e4cd122a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:53.788289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aad85-be76-4f0d-bdae-b8f4e4cd122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:53.809351 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-257aad85-be76-4f0d-bdae-b8f4e4cd122a None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:53.810656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-257aad85-be76-4f0d-bdae-b8f4e4cd122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:53.819539 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 505/1011] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:53.886337 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8da0f9-787a-406b-9960-2c1de91fed8e None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:53.905473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8da0f9-787a-406b-9960-2c1de91fed8e None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:53.912387 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ea449-8e1f-4465-8098-328a646c2314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:53.913221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ea449-8e1f-4465-8098-328a646c2314 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:53.913841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ea449-8e1f-4465-8098-328a646c2314 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:53.914185 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ea449-8e1f-4465-8098-328a646c2314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:53.928315 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ea449-8e1f-4465-8098-328a646c2314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:53.938690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ea449-8e1f-4465-8098-328a646c2314 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:53.962424 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 507/1012] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:57.085261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d407b6-eed5-4823-af21-4e17f18bed97 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:57.085958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d407b6-eed5-4823-af21-4e17f18bed97 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:57.085958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d407b6-eed5-4823-af21-4e17f18bed97 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:57.087615 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 506/1013] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:30:57.093979 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cc03-e3c1-448e-b5a1-cd7ba0bc4894 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:57.094617 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cc03-e3c1-448e-b5a1-cd7ba0bc4894 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:57.094617 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cc03-e3c1-448e-b5a1-cd7ba0bc4894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:57.116570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-2411cc03-e3c1-448e-b5a1-cd7ba0bc4894 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:30:57.117842 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-2411cc03-e3c1-448e-b5a1-cd7ba0bc4894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:30:57.127757 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 508/1014] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:30:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:30:57.183250 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d407b6-eed5-4823-af21-4e17f18bed97 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:30:57.191655 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=46 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:57.201154 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d407b6-eed5-4823-af21-4e17f18bed97 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:30:57.207145 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741f30a-98d4-4655-b5bf-b51224f73355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:30:57.207963 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741f30a-98d4-4655-b5bf-b51224f73355 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:30:57.208347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741f30a-98d4-4655-b5bf-b51224f73355 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:30:57.208723 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741f30a-98d4-4655-b5bf-b51224f73355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:30:57.219548 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741f30a-98d4-4655-b5bf-b51224f73355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:30:57.221330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741f30a-98d4-4655-b5bf-b51224f73355 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:30:57.232574 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 507/1015] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:30:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:01.413643 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1afbb4-06ad-4952-83cb-f7cedd94c944 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.414368 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1afbb4-06ad-4952-83cb-f7cedd94c944 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.414598 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1afbb4-06ad-4952-83cb-f7cedd94c944 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.417851 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 509/1016] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:31:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:01.426931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.429372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.429831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.442931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7df3a-458c-4dc9-8e76-cc5d8b347ccb None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.443412 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7df3a-458c-4dc9-8e76-cc5d8b347ccb None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.443855 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7df3a-458c-4dc9-8e76-cc5d8b347ccb None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.446479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 510/1017] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:31:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:01.454820 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510a159-f9dd-40e7-9e8a-3447423807fd None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.455393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510a159-f9dd-40e7-9e8a-3447423807fd None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.455880 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510a159-f9dd-40e7-9e8a-3447423807fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.461078 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:01.462508 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:01.471802 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 508/1018] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:31:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:01.487746 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-c510a159-f9dd-40e7-9e8a-3447423807fd None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:01.489940 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-c510a159-f9dd-40e7-9e8a-3447423807fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:01.504293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 511/1019] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:31:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:31:01.527906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:01.547479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf0ee-8fab-4cd1-9c67-eec267436d61 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:01.556417 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:01.557514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.557975 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.558547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.575492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:01.577479 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:01.588263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab405-07f3-4b20-9069-469bf8787280 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.588744 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab405-07f3-4b20-9069-469bf8787280 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.589172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab405-07f3-4b20-9069-469bf8787280 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.591734 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 512/1020] 10.222.0.65 () {54 vars in 962 bytes} [Thu Jul 14 14:31:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:01.592901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 509/1021] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:01.604942 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6c6e-b1c7-43c4-a240-ffff9eec0bb6 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.605486 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6c6e-b1c7-43c4-a240-ffff9eec0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.606017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6c6e-b1c7-43c4-a240-ffff9eec0bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.671281 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-0ded6c6e-b1c7-43c4-a240-ffff9eec0bb6 None None] MFA Rules not processed for user `02274dd74048403fa814884ad73c7ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:01.673517 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-0ded6c6e-b1c7-43c4-a240-ffff9eec0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:01.789835 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 513/1022] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Jul 14 14:31:01 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:01.798884 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:01.815811 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c04c1-6c04-422d-acac-f3ed91468e5a service nova] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:01.820991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4bea-303f-4f85-8cae-80b251d3a689 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02274dd74048403fa814884ad73c7ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:01.822436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4bea-303f-4f85-8cae-80b251d3a689 service glance] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:01.822836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4bea-303f-4f85-8cae-80b251d3a689 service glance] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:01.823166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4bea-303f-4f85-8cae-80b251d3a689 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:01.841490 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b4bea-303f-4f85-8cae-80b251d3a689 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:01.844826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b4bea-303f-4f85-8cae-80b251d3a689 service glance] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:01.860486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 510/1023] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:04.393215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2c0d-155a-4404-8762-ae85916797e3 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:04.393950 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2c0d-155a-4404-8762-ae85916797e3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:04.394293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2c0d-155a-4404-8762-ae85916797e3 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:04.397111 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 514/1024] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:31:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:04.404693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc4ae2-0612-4c88-a055-35b0c86a5c8c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:04.405324 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc4ae2-0612-4c88-a055-35b0c86a5c8c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:04.405494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc4ae2-0612-4c88-a055-35b0c86a5c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:04.438362 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-a9bc4ae2-0612-4c88-a055-35b0c86a5c8c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:04.439376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a9bc4ae2-0612-4c88-a055-35b0c86a5c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:04.454239 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 511/1025] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:31:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:04.507659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d2c0d-155a-4404-8762-ae85916797e3 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:04.523503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d2c0d-155a-4404-8762-ae85916797e3 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:04.533422 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f728a-c855-4563-b1e8-6551dc2526e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:04.534140 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f728a-c855-4563-b1e8-6551dc2526e3 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:04.534415 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f728a-c855-4563-b1e8-6551dc2526e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:04.534694 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f728a-c855-4563-b1e8-6551dc2526e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:04.546606 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f728a-c855-4563-b1e8-6551dc2526e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:04.552642 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f728a-c855-4563-b1e8-6551dc2526e3 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:04.560518 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 515/1026] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:14.427662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=23 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:14.555870 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=67 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:19.422065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955839-853d-499c-ba0c-06a021faf438 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:19.423097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955839-853d-499c-ba0c-06a021faf438 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:19.423097 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955839-853d-499c-ba0c-06a021faf438 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:19.424613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 512/1027] 10.222.0.65 () {54 vars in 918 bytes} [Thu Jul 14 14:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:19.439653 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb391b4-d251-4d0c-92bc-9d87c5d79be4 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:19.440597 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb391b4-d251-4d0c-92bc-9d87c5d79be4 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:19.440776 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb391b4-d251-4d0c-92bc-9d87c5d79be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:19.470063 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-beb391b4-d251-4d0c-92bc-9d87c5d79be4 None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:19.526712 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-beb391b4-d251-4d0c-92bc-9d87c5d79be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:19.536279 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 516/1028] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jul 14 14:31:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:31:19.554105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5479e-6459-428c-9b4f-867d41ab2281 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:19.554402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5479e-6459-428c-9b4f-867d41ab2281 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:19.554688 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5479e-6459-428c-9b4f-867d41ab2281 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:19.556127 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 513/1029] 10.222.0.65 () {54 vars in 918 bytes} [Thu Jul 14 14:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:19.561980 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7900c1f-ec0d-4aa6-8fe4-27c634f312d7 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:19.562270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7900c1f-ec0d-4aa6-8fe4-27c634f312d7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:19.562541 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7900c1f-ec0d-4aa6-8fe4-27c634f312d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:19.583247 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f7900c1f-ec0d-4aa6-8fe4-27c634f312d7 None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:19.584493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f7900c1f-ec0d-4aa6-8fe4-27c634f312d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:19.594139 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 517/1030] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jul 14 14:31:19 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:31:23.085515 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae97-129f-41d8-8802-aff741c3fd1c None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:23.086177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae97-129f-41d8-8802-aff741c3fd1c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:23.086177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae97-129f-41d8-8802-aff741c3fd1c None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:23.087705 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:23.095255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8ec5-068f-46f9-97c1-e275e3d2d476 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:23.095912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8ec5-068f-46f9-97c1-e275e3d2d476 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:23.095912 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8ec5-068f-46f9-97c1-e275e3d2d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:23.116286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-4a8d8ec5-068f-46f9-97c1-e275e3d2d476 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:23.117535 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4a8d8ec5-068f-46f9-97c1-e275e3d2d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:23.126947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:23.177132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae97-129f-41d8-8802-aff741c3fd1c None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:23.202563 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae97-129f-41d8-8802-aff741c3fd1c None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:23.210924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e87bdb-6a41-49c6-87f9-a8a707b8c184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:23.212029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e87bdb-6a41-49c6-87f9-a8a707b8c184 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:23.212494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e87bdb-6a41-49c6-87f9-a8a707b8c184 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:23.214102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e87bdb-6a41-49c6-87f9-a8a707b8c184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:23.229994 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e87bdb-6a41-49c6-87f9-a8a707b8c184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:23.232999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e87bdb-6a41-49c6-87f9-a8a707b8c184 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:23.252518 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 515/1033] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:24.406895 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99156f9-3316-4f57-a3fb-fdabb417d149 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:24.407650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99156f9-3316-4f57-a3fb-fdabb417d149 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:24.407650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99156f9-3316-4f57-a3fb-fdabb417d149 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:24.408932 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:24.415906 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8e884-45f3-4a7c-a641-78b873127caa None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:24.417159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8e884-45f3-4a7c-a641-78b873127caa None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:24.417492 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8e884-45f3-4a7c-a641-78b873127caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:24.449467 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5bc8e884-45f3-4a7c-a641-78b873127caa None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:24.451624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5bc8e884-45f3-4a7c-a641-78b873127caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:24.466096 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:24.706404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99156f9-3316-4f57-a3fb-fdabb417d149 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:24.722078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99156f9-3316-4f57-a3fb-fdabb417d149 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:24.728209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441449de-718a-4a61-9fff-4c3df52961b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:24.730364 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441449de-718a-4a61-9fff-4c3df52961b6 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:24.730650 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441449de-718a-4a61-9fff-4c3df52961b6 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:24.730933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441449de-718a-4a61-9fff-4c3df52961b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:24.741314 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441449de-718a-4a61-9fff-4c3df52961b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:24.742937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441449de-718a-4a61-9fff-4c3df52961b6 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:24.755129 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 520/1036] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:25.835102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd0c8-6b37-4d6d-b86e-40af473ce7e7 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:25.835704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd0c8-6b37-4d6d-b86e-40af473ce7e7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:25.835704 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd0c8-6b37-4d6d-b86e-40af473ce7e7 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:25.837233 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:25.844137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3030-28e9-478e-bec9-3228db6143e3 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:25.844926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3030-28e9-478e-bec9-3228db6143e3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:25.844926 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3030-28e9-478e-bec9-3228db6143e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:25.866435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-71ff3030-28e9-478e-bec9-3228db6143e3 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:25.868097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-71ff3030-28e9-478e-bec9-3228db6143e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:25.876994 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:26.050000 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd0c8-6b37-4d6d-b86e-40af473ce7e7 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:26.066499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd0c8-6b37-4d6d-b86e-40af473ce7e7 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:26.071824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8dffb-1d50-41f3-9b44-bc3d0abcbdee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:26.072682 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dffb-1d50-41f3-9b44-bc3d0abcbdee service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:26.072968 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dffb-1d50-41f3-9b44-bc3d0abcbdee service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:26.073251 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dffb-1d50-41f3-9b44-bc3d0abcbdee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:26.083166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8dffb-1d50-41f3-9b44-bc3d0abcbdee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:26.084911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8dffb-1d50-41f3-9b44-bc3d0abcbdee service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:26.096330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 518/1039] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:27.109001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9680-221d-41d1-998e-7ed0474f2cd0 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:27.109581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9680-221d-41d1-998e-7ed0474f2cd0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:27.109581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9680-221d-41d1-998e-7ed0474f2cd0 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:27.115104 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:27.117749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e31e-45d0-4232-b5c3-7a08098df0ab None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:27.118226 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e31e-45d0-4232-b5c3-7a08098df0ab None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:27.118702 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e31e-45d0-4232-b5c3-7a08098df0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:27.148939 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-f5c9e31e-45d0-4232-b5c3-7a08098df0ab None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:27.151639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-f5c9e31e-45d0-4232-b5c3-7a08098df0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:27.167373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:27.338447 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9680-221d-41d1-998e-7ed0474f2cd0 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:27.352377 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9680-221d-41d1-998e-7ed0474f2cd0 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:27.359149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785e51-d626-494c-b775-ccf2235f4f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:27.359809 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785e51-d626-494c-b775-ccf2235f4f01 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:27.360094 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785e51-d626-494c-b775-ccf2235f4f01 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:27.360371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785e51-d626-494c-b775-ccf2235f4f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:27.371390 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0785e51-d626-494c-b775-ccf2235f4f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:27.373103 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0785e51-d626-494c-b775-ccf2235f4f01 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:27.387691 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 523/1042] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:28.543173 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c52c-d1f7-4782-9c4f-974aeb9304e9 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:28.543792 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c52c-d1f7-4782-9c4f-974aeb9304e9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:28.543792 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c52c-d1f7-4782-9c4f-974aeb9304e9 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:28.545255 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:28.553412 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f965b-963f-4143-a822-41529b1dc22c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:28.553959 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f965b-963f-4143-a822-41529b1dc22c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:28.554076 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f965b-963f-4143-a822-41529b1dc22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:28.577970 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-115f965b-963f-4143-a822-41529b1dc22c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:28.580169 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-115f965b-963f-4143-a822-41529b1dc22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:28.591921 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:28.765832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481c52c-d1f7-4782-9c4f-974aeb9304e9 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:28.789130 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481c52c-d1f7-4782-9c4f-974aeb9304e9 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:28.797079 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a032c-0e65-412b-82e9-44d8ad1b8036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:28.798069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a032c-0e65-412b-82e9-44d8ad1b8036 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:28.798510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a032c-0e65-412b-82e9-44d8ad1b8036 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:28.798952 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a032c-0e65-412b-82e9-44d8ad1b8036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:28.815816 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a032c-0e65-412b-82e9-44d8ad1b8036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:28.819208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a032c-0e65-412b-82e9-44d8ad1b8036 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:28.839924 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 521/1045] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:29.927417 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f820-2ecd-42dc-9b5e-92f3bfa319c5 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:29.928001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f820-2ecd-42dc-9b5e-92f3bfa319c5 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:29.928001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f820-2ecd-42dc-9b5e-92f3bfa319c5 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:29.929378 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:29.936409 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdecdb8-48c1-44e5-ac47-2f693706ea3c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:29.937022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdecdb8-48c1-44e5-ac47-2f693706ea3c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:29.937022 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdecdb8-48c1-44e5-ac47-2f693706ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:29.966175 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-4cdecdb8-48c1-44e5-ac47-2f693706ea3c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:29.968281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-4cdecdb8-48c1-44e5-ac47-2f693706ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:29.982414 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:31:30.145176 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1f820-2ecd-42dc-9b5e-92f3bfa319c5 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:30.162631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1f820-2ecd-42dc-9b5e-92f3bfa319c5 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:30.170077 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dbb93-9ff8-4cc2-b873-8caebaae125b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:30.170907 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dbb93-9ff8-4cc2-b873-8caebaae125b service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:30.171320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dbb93-9ff8-4cc2-b873-8caebaae125b service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:30.171708 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dbb93-9ff8-4cc2-b873-8caebaae125b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:30.182081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dbb93-9ff8-4cc2-b873-8caebaae125b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:30.183593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dbb93-9ff8-4cc2-b873-8caebaae125b service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:30.195194 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 526/1048] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:31.089810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a671-0817-4d30-aed7-59f37f4cbdad None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:31.090796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a671-0817-4d30-aed7-59f37f4cbdad None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:31.090796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a671-0817-4d30-aed7-59f37f4cbdad None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:31.092081 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:31.101404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bebbb4-24c2-4ef5-a07a-51f63bf16f8f None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:31.101984 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bebbb4-24c2-4ef5-a07a-51f63bf16f8f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:31.102433 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bebbb4-24c2-4ef5-a07a-51f63bf16f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:31.133869 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-f4bebbb4-24c2-4ef5-a07a-51f63bf16f8f None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:31.136359 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f4bebbb4-24c2-4ef5-a07a-51f63bf16f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:31.150203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:31.319693 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04a671-0817-4d30-aed7-59f37f4cbdad None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:31.334483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04a671-0817-4d30-aed7-59f37f4cbdad None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:31.341191 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b188aa-9e7b-4a82-ac3b-a5a15f584dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:31.341851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b188aa-9e7b-4a82-ac3b-a5a15f584dee service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:31.342138 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b188aa-9e7b-4a82-ac3b-a5a15f584dee service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:31.342418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b188aa-9e7b-4a82-ac3b-a5a15f584dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:31.352792 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b188aa-9e7b-4a82-ac3b-a5a15f584dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:31.354868 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b188aa-9e7b-4a82-ac3b-a5a15f584dee service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:31.366677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 524/1051] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:32.273386 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3c6b-da6e-4c0c-8aa8-5d060b648c82 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:32.273987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3c6b-da6e-4c0c-8aa8-5d060b648c82 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:32.273987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3c6b-da6e-4c0c-8aa8-5d060b648c82 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:32.275914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:32.281937 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ed34c-bd7f-42bb-b71d-45d8df094df6 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:32.282483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ed34c-bd7f-42bb-b71d-45d8df094df6 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:32.282483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ed34c-bd7f-42bb-b71d-45d8df094df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:32.301646 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-ef6ed34c-bd7f-42bb-b71d-45d8df094df6 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:32.303124 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-ef6ed34c-bd7f-42bb-b71d-45d8df094df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:32.312306 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:32.483224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3c6b-da6e-4c0c-8aa8-5d060b648c82 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:32.497992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3c6b-da6e-4c0c-8aa8-5d060b648c82 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:32.503392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c3234-c74e-4988-9f42-ab08b373a2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:32.504059 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c3234-c74e-4988-9f42-ab08b373a2f7 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:32.504347 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c3234-c74e-4988-9f42-ab08b373a2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:32.504628 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c3234-c74e-4988-9f42-ab08b373a2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:32.514588 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c3234-c74e-4988-9f42-ab08b373a2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:32.516261 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c3234-c74e-4988-9f42-ab08b373a2f7 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:32.533215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 529/1054] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:33.402613 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb6b9-2c7b-45cf-8df3-3588b0bf5c14 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:33.403372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb6b9-2c7b-45cf-8df3-3588b0bf5c14 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:33.403662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb6b9-2c7b-45cf-8df3-3588b0bf5c14 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:33.405460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:31:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:33.414442 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16a3b2-95ed-470c-8a7e-eca34c83f7f0 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:33.415582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16a3b2-95ed-470c-8a7e-eca34c83f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:33.415907 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16a3b2-95ed-470c-8a7e-eca34c83f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:33.444906 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-7a16a3b2-95ed-470c-8a7e-eca34c83f7f0 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:33.446722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-7a16a3b2-95ed-470c-8a7e-eca34c83f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:33.455858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:31:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:33.621845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cb6b9-2c7b-45cf-8df3-3588b0bf5c14 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:33.636624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cb6b9-2c7b-45cf-8df3-3588b0bf5c14 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:33.642366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8929f-8628-41ef-886f-b6d2715e8b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:33.643112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8929f-8628-41ef-886f-b6d2715e8b0a service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:33.643440 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8929f-8628-41ef-886f-b6d2715e8b0a service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:33.643754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8929f-8628-41ef-886f-b6d2715e8b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:33.653514 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8929f-8628-41ef-886f-b6d2715e8b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:33.655234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8929f-8628-41ef-886f-b6d2715e8b0a service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:33.666553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 527/1057] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:36.033089 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad972-a9a9-4346-affb-77f79d12eb0a None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:36.033713 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad972-a9a9-4346-affb-77f79d12eb0a None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:36.033713 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad972-a9a9-4346-affb-77f79d12eb0a None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:36.035140 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:36.042394 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7a5c-be92-4ae1-a69a-eb162d0e8a11 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:36.043017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7a5c-be92-4ae1-a69a-eb162d0e8a11 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:36.043017 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7a5c-be92-4ae1-a69a-eb162d0e8a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:36.065713 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-347e7a5c-be92-4ae1-a69a-eb162d0e8a11 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:36.067602 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-347e7a5c-be92-4ae1-a69a-eb162d0e8a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:36.078746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:31:36.132116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad972-a9a9-4346-affb-77f79d12eb0a None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:36.148366 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad972-a9a9-4346-affb-77f79d12eb0a None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:36.152840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bac36-4289-4c0f-b037-e9ec09b54abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:36.153503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bac36-4289-4c0f-b037-e9ec09b54abe service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:36.153787 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bac36-4289-4c0f-b037-e9ec09b54abe service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:36.154062 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bac36-4289-4c0f-b037-e9ec09b54abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:36.166255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bac36-4289-4c0f-b037-e9ec09b54abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:36.168155 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bac36-4289-4c0f-b037-e9ec09b54abe service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:36.180416 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 532/1060] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:39.065460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dcc88-8dde-4660-b355-5a8b599b0564 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:39.066255 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dcc88-8dde-4660-b355-5a8b599b0564 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:39.066648 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dcc88-8dde-4660-b355-5a8b599b0564 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:39.068261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:39.075604 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d0fc-790d-477f-a78e-ce4026dd6234 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:39.076435 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d0fc-790d-477f-a78e-ce4026dd6234 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:39.076627 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d0fc-790d-477f-a78e-ce4026dd6234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:39.098159 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-5f41d0fc-790d-477f-a78e-ce4026dd6234 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:39.099503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-5f41d0fc-790d-477f-a78e-ce4026dd6234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:39.108943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:39.151320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dcc88-8dde-4660-b355-5a8b599b0564 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:39.163143 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dcc88-8dde-4660-b355-5a8b599b0564 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:39.167902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703da894-5b14-42c0-9db7-a0738313f4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:39.168567 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da894-5b14-42c0-9db7-a0738313f4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:39.168851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da894-5b14-42c0-9db7-a0738313f4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:39.169124 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da894-5b14-42c0-9db7-a0738313f4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:39.179402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da894-5b14-42c0-9db7-a0738313f4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:39.181341 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da894-5b14-42c0-9db7-a0738313f4f8 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:39.192844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 530/1063] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:42.272652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084d0e-a8c2-4ee3-a459-197df7060901 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:42.273882 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084d0e-a8c2-4ee3-a459-197df7060901 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:42.273882 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084d0e-a8c2-4ee3-a459-197df7060901 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:42.275459 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:42.281584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4fda-be53-4ae9-bdd2-77d1443b14f2 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:42.282409 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4fda-be53-4ae9-bdd2-77d1443b14f2 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:42.282409 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4fda-be53-4ae9-bdd2-77d1443b14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:42.310689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-870c4fda-be53-4ae9-bdd2-77d1443b14f2 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:42.312788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-870c4fda-be53-4ae9-bdd2-77d1443b14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:42.326742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:42.370275 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084d0e-a8c2-4ee3-a459-197df7060901 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:42.384112 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084d0e-a8c2-4ee3-a459-197df7060901 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:42.390064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024854-dec4-448b-a884-48676da24639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:42.391228 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024854-dec4-448b-a884-48676da24639 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:42.391794 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024854-dec4-448b-a884-48676da24639 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:42.392192 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024854-dec4-448b-a884-48676da24639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:42.404133 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024854-dec4-448b-a884-48676da24639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:42.405866 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024854-dec4-448b-a884-48676da24639 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:42.420763 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 535/1066] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:45.083282 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16add59-c662-4fcd-9dc0-d76675ec0b3b None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:45.084080 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16add59-c662-4fcd-9dc0-d76675ec0b3b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:45.084213 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16add59-c662-4fcd-9dc0-d76675ec0b3b None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:45.087041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:45.093090 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d522d0-1da1-4b66-940e-09fabc632966 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:45.093640 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d522d0-1da1-4b66-940e-09fabc632966 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:45.093826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d522d0-1da1-4b66-940e-09fabc632966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:45.100516 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=61 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:45.116247 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-58d522d0-1da1-4b66-940e-09fabc632966 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:45.119049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-58d522d0-1da1-4b66-940e-09fabc632966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:45.127574 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:45.170462 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16add59-c662-4fcd-9dc0-d76675ec0b3b None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:45.176552 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=55 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:45.184510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16add59-c662-4fcd-9dc0-d76675ec0b3b None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:45.188547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d9097-29b4-4fb6-a94c-7674d4301863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:45.189605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d9097-29b4-4fb6-a94c-7674d4301863 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:45.189933 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d9097-29b4-4fb6-a94c-7674d4301863 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:45.190256 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d9097-29b4-4fb6-a94c-7674d4301863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:45.201561 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d9097-29b4-4fb6-a94c-7674d4301863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:45.203511 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d9097-29b4-4fb6-a94c-7674d4301863 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:45.215327 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 533/1069] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:47.811660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d9c3-34dd-4218-a177-3b7f9c537503 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:47.812225 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d9c3-34dd-4218-a177-3b7f9c537503 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:47.812355 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d9c3-34dd-4218-a177-3b7f9c537503 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:47.813858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:47.823009 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180423f-7ec9-481e-850f-d71ec5d1ce54 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:47.823651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180423f-7ec9-481e-850f-d71ec5d1ce54 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:47.823651 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180423f-7ec9-481e-850f-d71ec5d1ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:47.844989 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-1180423f-7ec9-481e-850f-d71ec5d1ce54 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:47.846248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-1180423f-7ec9-481e-850f-d71ec5d1ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:47.855763 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:47.898286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d9c3-34dd-4218-a177-3b7f9c537503 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:47.910188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d9c3-34dd-4218-a177-3b7f9c537503 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:47.915008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1b797-386e-46e0-afff-153494cc841d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:47.915663 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1b797-386e-46e0-afff-153494cc841d service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:47.915947 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1b797-386e-46e0-afff-153494cc841d service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:47.916251 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1b797-386e-46e0-afff-153494cc841d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:47.926555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1b797-386e-46e0-afff-153494cc841d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:47.928153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1b797-386e-46e0-afff-153494cc841d service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:47.940422 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 538/1072] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:31:50.563049 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc293b53-a20f-4794-8d5c-0a8e00bee669 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:50.564007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc293b53-a20f-4794-8d5c-0a8e00bee669 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:50.564007 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc293b53-a20f-4794-8d5c-0a8e00bee669 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:50.565271 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:50.572873 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a9b38-da58-4442-955d-959a3ff9cf94 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:50.573488 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a9b38-da58-4442-955d-959a3ff9cf94 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:50.573624 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a9b38-da58-4442-955d-959a3ff9cf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:50.594382 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-102a9b38-da58-4442-955d-959a3ff9cf94 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:50.595868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-102a9b38-da58-4442-955d-959a3ff9cf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:50.604536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:31:50.647784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc293b53-a20f-4794-8d5c-0a8e00bee669 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:50.660573 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc293b53-a20f-4794-8d5c-0a8e00bee669 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:50.665490 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c4bb1-df90-44d7-a7c1-8c93c2c6ffd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:50.666149 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c4bb1-df90-44d7-a7c1-8c93c2c6ffd5 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:50.666473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c4bb1-df90-44d7-a7c1-8c93c2c6ffd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:50.666744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c4bb1-df90-44d7-a7c1-8c93c2c6ffd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:50.677942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c4bb1-df90-44d7-a7c1-8c93c2c6ffd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:50.680284 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c4bb1-df90-44d7-a7c1-8c93c2c6ffd5 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:50.692285 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 536/1075] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:53.956526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ae59-e2dc-438f-bc82-fcc72bb3ef54 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:53.957113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ae59-e2dc-438f-bc82-fcc72bb3ef54 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:53.957113 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ae59-e2dc-438f-bc82-fcc72bb3ef54 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:53.958527 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:53.965980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c3d9-44d0-452c-93fa-210ceea1d295 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:53.966581 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c3d9-44d0-452c-93fa-210ceea1d295 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:53.966873 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c3d9-44d0-452c-93fa-210ceea1d295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:53.990092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-20b9c3d9-44d0-452c-93fa-210ceea1d295 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:53.991550 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-20b9c3d9-44d0-452c-93fa-210ceea1d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:53.999836 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:54.041234 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4ae59-e2dc-438f-bc82-fcc72bb3ef54 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:54.054536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4ae59-e2dc-438f-bc82-fcc72bb3ef54 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:54.058481 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a966a-a7da-4f8c-a11e-e64a25385adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:54.059217 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a966a-a7da-4f8c-a11e-e64a25385adb service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:54.059492 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a966a-a7da-4f8c-a11e-e64a25385adb service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:54.059764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a966a-a7da-4f8c-a11e-e64a25385adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:54.070799 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a966a-a7da-4f8c-a11e-e64a25385adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:54.072301 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a966a-a7da-4f8c-a11e-e64a25385adb service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:54.084877 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 541/1078] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:56.671936 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ec1c-c441-4c29-9d15-f62a3bf0c127 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:56.672879 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ec1c-c441-4c29-9d15-f62a3bf0c127 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:56.672879 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ec1c-c441-4c29-9d15-f62a3bf0c127 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:56.673919 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:31:56.680507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4521c7-4c08-4835-b85f-100f48893323 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:56.681117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4521c7-4c08-4835-b85f-100f48893323 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:56.681117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4521c7-4c08-4835-b85f-100f48893323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:56.702020 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-da4521c7-4c08-4835-b85f-100f48893323 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:56.703645 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-da4521c7-4c08-4835-b85f-100f48893323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:56.712418 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:56.752747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ec1c-c441-4c29-9d15-f62a3bf0c127 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:56.764762 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ec1c-c441-4c29-9d15-f62a3bf0c127 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:56.768599 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8e07-4608-46af-83cb-fad990648d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:56.769232 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8e07-4608-46af-83cb-fad990648d0c service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:56.769517 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8e07-4608-46af-83cb-fad990648d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:56.769793 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8e07-4608-46af-83cb-fad990648d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:56.781304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc8e07-4608-46af-83cb-fad990648d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:56.782683 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc8e07-4608-46af-83cb-fad990648d0c service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:56.793851 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 539/1081] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:31:59.325292 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f6340-bb06-4fcf-ada1-6e0cd6d8b01f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:59.325849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f6340-bb06-4fcf-ada1-6e0cd6d8b01f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:59.325849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f6340-bb06-4fcf-ada1-6e0cd6d8b01f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:59.327222 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:31:59.336988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af8559-0102-4339-907e-820526e119c0 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:59.337686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af8559-0102-4339-907e-820526e119c0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:59.337686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af8559-0102-4339-907e-820526e119c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:59.357439 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-25af8559-0102-4339-907e-820526e119c0 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:31:59.358690 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-25af8559-0102-4339-907e-820526e119c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:31:59.368059 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:31:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:31:59.409716 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f6340-bb06-4fcf-ada1-6e0cd6d8b01f None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:31:59.421674 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f6340-bb06-4fcf-ada1-6e0cd6d8b01f None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:31:59.426749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8832c-f4ba-4c1d-802c-f2e6acbc1aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:31:59.429440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8832c-f4ba-4c1d-802c-f2e6acbc1aaf service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:31:59.429943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8832c-f4ba-4c1d-802c-f2e6acbc1aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:31:59.430452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8832c-f4ba-4c1d-802c-f2e6acbc1aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:31:59.450149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8832c-f4ba-4c1d-802c-f2e6acbc1aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:31:59.453040 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8832c-f4ba-4c1d-802c-f2e6acbc1aaf service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:31:59.472868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 544/1084] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:31:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:01.994903 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99b0e0-2082-4a22-b690-c11744158e5b None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:01.995572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99b0e0-2082-4a22-b690-c11744158e5b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:01.995572 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99b0e0-2082-4a22-b690-c11744158e5b None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:01.996898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:32:02.003155 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7220-d142-4d48-b528-cdca4cc557a0 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:02.003751 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7220-d142-4d48-b528-cdca4cc557a0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:02.003751 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7220-d142-4d48-b528-cdca4cc557a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:02.024163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-feeb7220-d142-4d48-b528-cdca4cc557a0 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:02.025456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-feeb7220-d142-4d48-b528-cdca4cc557a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:02.034408 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:32:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:32:02.078927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99b0e0-2082-4a22-b690-c11744158e5b None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:02.091991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99b0e0-2082-4a22-b690-c11744158e5b None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:02.096237 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907c961-e383-4202-accb-2d5b1f3bad23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:02.096950 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c961-e383-4202-accb-2d5b1f3bad23 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:02.097277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c961-e383-4202-accb-2d5b1f3bad23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:02.097599 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c961-e383-4202-accb-2d5b1f3bad23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:02.109377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c961-e383-4202-accb-2d5b1f3bad23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:02.111019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c961-e383-4202-accb-2d5b1f3bad23 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:02.124094 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 542/1087] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:12.018561 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=29 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:12.119624 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=32 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:30.162530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720d1f3-6129-47d5-96f4-b9a4ec4fa63b None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:30.163274 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720d1f3-6129-47d5-96f4-b9a4ec4fa63b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:30.163274 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720d1f3-6129-47d5-96f4-b9a4ec4fa63b None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:30.164524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 546/1088] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:32:30.170700 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698a702-e367-41ca-9001-a25a40d3704d None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:30.171376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698a702-e367-41ca-9001-a25a40d3704d None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:30.171503 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698a702-e367-41ca-9001-a25a40d3704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:30.193925 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-9698a702-e367-41ca-9001-a25a40d3704d None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:30.195214 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-9698a702-e367-41ca-9001-a25a40d3704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:30.203799 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 543/1089] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:30.258745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf359-7445-477c-b86d-1c6a592b7353 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:30.259068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf359-7445-477c-b86d-1c6a592b7353 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:30.259352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf359-7445-477c-b86d-1c6a592b7353 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:30.260739 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 547/1090] 10.222.0.65 () {54 vars in 962 bytes} [Thu Jul 14 14:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:32:30.267108 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec293ef-95f7-4179-8db4-7fd6621ed613 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:30.267377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec293ef-95f7-4179-8db4-7fd6621ed613 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:30.267737 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec293ef-95f7-4179-8db4-7fd6621ed613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:30.289398 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-3ec293ef-95f7-4179-8db4-7fd6621ed613 None None] MFA Rules not processed for user `02274dd74048403fa814884ad73c7ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:30.290665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3ec293ef-95f7-4179-8db4-7fd6621ed613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:30.297677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 544/1091] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Jul 14 14:32:30 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:30.307357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf359-7445-477c-b86d-1c6a592b7353 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:30.321841 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf359-7445-477c-b86d-1c6a592b7353 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:30.325967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55829-c6b4-46f5-ae17-787802b71516 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02274dd74048403fa814884ad73c7ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:30.326634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55829-c6b4-46f5-ae17-787802b71516 service glance] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:30.326920 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55829-c6b4-46f5-ae17-787802b71516 service glance] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:30.327237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55829-c6b4-46f5-ae17-787802b71516 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:30.339405 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55829-c6b4-46f5-ae17-787802b71516 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:30.340913 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55829-c6b4-46f5-ae17-787802b71516 service glance] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:30.353271 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 548/1092] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:32:33.474858 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0127c2-6c3c-4b5b-86c2-f747af8ed520 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:33.475497 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0127c2-6c3c-4b5b-86c2-f747af8ed520 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:33.475497 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0127c2-6c3c-4b5b-86c2-f747af8ed520 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:33.476920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 545/1093] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:32:33.482945 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2f8a-1a82-4115-a486-009aba8d65e9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:33.483717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2f8a-1a82-4115-a486-009aba8d65e9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:33.483717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2f8a-1a82-4115-a486-009aba8d65e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:33.503452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-db5b2f8a-1a82-4115-a486-009aba8d65e9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:33.504690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-db5b2f8a-1a82-4115-a486-009aba8d65e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:33.513216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 549/1094] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:33.543322 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0127c2-6c3c-4b5b-86c2-f747af8ed520 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:33.557499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0127c2-6c3c-4b5b-86c2-f747af8ed520 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:33.562824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:33.563755 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:33.564175 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:33.564460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:33.565355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:33.567267 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:32:33.567267 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:32:33.567267 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:32:33.568426 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae60f68-8833-4448-9119-30cb853ad18a admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:33.592356 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 546/1095] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jul 14 14:32:33 2022] GET /identity/v3/projects => generated 1606 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:32:36.224428 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99828-9dfa-4c4b-a652-89744512131c None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:36.225231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99828-9dfa-4c4b-a652-89744512131c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:36.225231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99828-9dfa-4c4b-a652-89744512131c None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:36.227078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 550/1096] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:32:36.234641 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93183388-dc3c-4664-86a5-61849069f91c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:36.235344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93183388-dc3c-4664-86a5-61849069f91c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:36.235344 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93183388-dc3c-4664-86a5-61849069f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:36.256260 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-93183388-dc3c-4664-86a5-61849069f91c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:36.257639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-93183388-dc3c-4664-86a5-61849069f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:36.268831 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 547/1097] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:32:36.320149 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99828-9dfa-4c4b-a652-89744512131c None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:36.337150 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99828-9dfa-4c4b-a652-89744512131c None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:36.342710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d64c6-d262-4976-b58f-d9a7bd858b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:36.343424 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d64c6-d262-4976-b58f-d9a7bd858b34 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:36.343712 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d64c6-d262-4976-b58f-d9a7bd858b34 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:36.344021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d64c6-d262-4976-b58f-d9a7bd858b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:36.354335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d64c6-d262-4976-b58f-d9a7bd858b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:36.356106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d64c6-d262-4976-b58f-d9a7bd858b34 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:36.368045 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 551/1098] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:39.227134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e28a-3267-4889-8150-c7d74937650a None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:39.227724 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e28a-3267-4889-8150-c7d74937650a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:39.227845 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e28a-3267-4889-8150-c7d74937650a None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:39.230209 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 548/1099] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:32:39.238199 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b425-758f-46bd-9bb4-f912f363904c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:39.239073 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b425-758f-46bd-9bb4-f912f363904c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:39.239073 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b425-758f-46bd-9bb4-f912f363904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:39.260517 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-06d0b425-758f-46bd-9bb4-f912f363904c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:39.261822 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-06d0b425-758f-46bd-9bb4-f912f363904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:39.273547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 552/1100] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:39.328983 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e28a-3267-4889-8150-c7d74937650a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:39.342837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e28a-3267-4889-8150-c7d74937650a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:39.347665 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4ec5-f8f1-4ef3-a4f8-80af714b8b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:39.348317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4ec5-f8f1-4ef3-a4f8-80af714b8b34 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:39.348644 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4ec5-f8f1-4ef3-a4f8-80af714b8b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:39.348963 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4ec5-f8f1-4ef3-a4f8-80af714b8b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:39.360019 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4ec5-f8f1-4ef3-a4f8-80af714b8b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:39.362549 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4ec5-f8f1-4ef3-a4f8-80af714b8b34 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:39.374044 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 549/1101] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:42.051048 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f301c-27b8-4ee8-b2ba-6bd4c2c8b511 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:42.051695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f301c-27b8-4ee8-b2ba-6bd4c2c8b511 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:42.051695 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f301c-27b8-4ee8-b2ba-6bd4c2c8b511 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:42.053385 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 553/1102] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:32:42.060822 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fddbe3-b10c-41d6-b1c0-3442464c7358 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:42.061422 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fddbe3-b10c-41d6-b1c0-3442464c7358 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:42.061795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fddbe3-b10c-41d6-b1c0-3442464c7358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:42.092927 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-12fddbe3-b10c-41d6-b1c0-3442464c7358 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:42.095616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-12fddbe3-b10c-41d6-b1c0-3442464c7358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:42.111759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 550/1103] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:42.153505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f301c-27b8-4ee8-b2ba-6bd4c2c8b511 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:42.166264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f301c-27b8-4ee8-b2ba-6bd4c2c8b511 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:42.170485 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a19b77-e18a-45dc-9765-ca15e6a1146b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:42.171729 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a19b77-e18a-45dc-9765-ca15e6a1146b service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:42.172457 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a19b77-e18a-45dc-9765-ca15e6a1146b service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:42.173126 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a19b77-e18a-45dc-9765-ca15e6a1146b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:42.186569 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a19b77-e18a-45dc-9765-ca15e6a1146b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:42.188101 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a19b77-e18a-45dc-9765-ca15e6a1146b service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:42.199898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 554/1104] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:45.019160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c83b2-7389-4671-9617-5c8086a572f0 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:45.019784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c83b2-7389-4671-9617-5c8086a572f0 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:45.020136 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c83b2-7389-4671-9617-5c8086a572f0 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:45.022930 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 551/1105] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:32:45.030690 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9b1b-b20b-4a0e-872a-9723591e7217 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:45.031336 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9b1b-b20b-4a0e-872a-9723591e7217 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:45.031336 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9b1b-b20b-4a0e-872a-9723591e7217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:45.051792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-47aa9b1b-b20b-4a0e-872a-9723591e7217 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:45.053036 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-47aa9b1b-b20b-4a0e-872a-9723591e7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:45.062013 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 555/1106] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:32:45.109890 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c83b2-7389-4671-9617-5c8086a572f0 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:45.124258 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c83b2-7389-4671-9617-5c8086a572f0 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:45.128384 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204491b-5507-4f77-9064-b2a4283642e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:45.129048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204491b-5507-4f77-9064-b2a4283642e0 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:45.129330 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204491b-5507-4f77-9064-b2a4283642e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:45.129604 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204491b-5507-4f77-9064-b2a4283642e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:45.142234 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204491b-5507-4f77-9064-b2a4283642e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:45.143963 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204491b-5507-4f77-9064-b2a4283642e0 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:45.161131 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 552/1107] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:48.097526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ea68a-9ed9-45e3-83df-b9c8b47f1fc0 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:48.098081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ea68a-9ed9-45e3-83df-b9c8b47f1fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:48.098081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ea68a-9ed9-45e3-83df-b9c8b47f1fc0 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:48.099480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 556/1108] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jul 14 14:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:32:48.105979 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966ed8-ba4f-4856-a8e9-baab895a399b None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:48.106600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966ed8-ba4f-4856-a8e9-baab895a399b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:48.106600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966ed8-ba4f-4856-a8e9-baab895a399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:48.128986 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e8966ed8-ba4f-4856-a8e9-baab895a399b None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:32:48.131257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e8966ed8-ba4f-4856-a8e9-baab895a399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:32:48.140473 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 553/1109] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jul 14 14:32:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:32:48.186205 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ea68a-9ed9-45e3-83df-b9c8b47f1fc0 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:32:48.198847 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ea68a-9ed9-45e3-83df-b9c8b47f1fc0 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:32:48.203943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6483968-9a54-4dfd-945f-d0a95db002ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:32:48.204987 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483968-9a54-4dfd-945f-d0a95db002ad service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:32:48.205489 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483968-9a54-4dfd-945f-d0a95db002ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:32:48.206400 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483968-9a54-4dfd-945f-d0a95db002ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:32:48.218144 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483968-9a54-4dfd-945f-d0a95db002ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:32:48.219745 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483968-9a54-4dfd-945f-d0a95db002ad service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:32:48.233903 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 557/1110] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:32:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:32:58.121109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=33 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:58.226762 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=33 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:37.931943 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:37.932898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:37.932898 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.018688 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:34:38.019969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:38.072077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 554/1111] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:34:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:34:38.088660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.089376 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.089376 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.110455 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:34:38.111753 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:38.124018 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 558/1112] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:34:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:34:38.129176 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.141248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d17fd-30e5-4479-be8e-fc1a18f88c06 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.146752 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.147591 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.147909 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.148232 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.149938 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:34:38.150363 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.151872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:38.151872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:34:38.151872 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:34:38.153247 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.168525 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 555/1113] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jul 14 14:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:34:38.178593 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.189670 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e22532-d489-41a8-89a7-9bc6f4808af2 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.194468 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.195185 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.195960 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.196320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.197053 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.198887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:38.198887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:34:38.198887 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:34:38.200172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.244098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 559/1114] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jul 14 14:34:38 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:34:38.248593 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.261168 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850009de-a00f-405e-bc6b-50fdca553c5b admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.333347 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.334098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.334382 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.334675 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.335434 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.337112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:38.337112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:34:38.337112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:34:38.338451 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.368281 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 556/1115] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jul 14 14:34:38 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:34:38.372081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.384854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e3e6a-255c-4575-9c1d-e3d6ac5ad7af admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.390473 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.391197 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.391524 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.391834 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.392568 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.393587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:38.393587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:34:38.393587 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:34:38.394482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.411556 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 560/1116] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:34:38.416824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.428257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3044f-9ad3-4d71-8364-9294f8bfaf2b admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.434076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.434779 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.435092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.435376 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.436180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.437314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:38.437314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:34:38.437314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:34:38.438276 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c260ef-9f6e-4f41-9740-eedb2ee9315a admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.453538 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 557/1117] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:34:38.460307 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.480344 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61f263-2199-434a-8940-a9726c4818ed admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.488904 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.490379 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.490895 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.491519 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] PATH_INFO: `/v3/projects/f106b66d75df47c8a93da68f32f022ab/users/4932264e76f046e4b03fe8865fe81b60/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.525808 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f106b66d75df47c8a93da68f32f022ab, user_id=4932264e76f046e4b03fe8865fe81b60, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.527825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:38.527825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:34:38.527825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:34:38.531816 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b1d3f-f3e6-4aa3-8ed0-61a887943baa admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.555611 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 561/1118] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:34:38 2022] PUT /identity/v3/projects/f106b66d75df47c8a93da68f32f022ab/users/4932264e76f046e4b03fe8865fe81b60/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:34:38.577280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9ce08-8188-4901-86ea-1d107e5caac3 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.577569 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9ce08-8188-4901-86ea-1d107e5caac3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.577849 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9ce08-8188-4901-86ea-1d107e5caac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.619279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e6b9ce08-8188-4901-86ea-1d107e5caac3 None None] MFA Rules not processed for user `4932264e76f046e4b03fe8865fe81b60`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:34:38.621383 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e6b9ce08-8188-4901-86ea-1d107e5caac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:38.682821 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:38.733443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 558/1119] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:34:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:34:38.748678 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8ff2-a619-4841-a68c-b7d50a25ad00 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.749105 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8ff2-a619-4841-a68c-b7d50a25ad00 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.749478 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8ff2-a619-4841-a68c-b7d50a25ad00 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.751071 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 562/1120] 10.222.0.65 () {54 vars in 963 bytes} [Thu Jul 14 14:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:34:38.757265 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2414-3f07-4c13-a469-422da212b5e3 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.757589 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2414-3f07-4c13-a469-422da212b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.758568 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2414-3f07-4c13-a469-422da212b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.805529 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-bc5b2414-3f07-4c13-a469-422da212b5e3 None None] MFA Rules not processed for user `ef8b686560994350b28cd4c6016b4fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:34:38.806791 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-bc5b2414-3f07-4c13-a469-422da212b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:38.925571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 559/1121] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Jul 14 14:34:38 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:34:38.941293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8ff2-a619-4841-a68c-b7d50a25ad00 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:38.953910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8ff2-a619-4841-a68c-b7d50a25ad00 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:38.960130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8b686560994350b28cd4c6016b4fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:38.960937 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:38.961939 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:38.962456 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:38.973014 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:38.974509 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:38.987806 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 563/1122] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:34:38 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:34:39.032844 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410fb2-75d7-4a8d-9c14-19ce4dbc4fc2 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:39.033464 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410fb2-75d7-4a8d-9c14-19ce4dbc4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:39.033464 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410fb2-75d7-4a8d-9c14-19ce4dbc4fc2 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:39.035065 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 560/1123] 10.222.0.65 () {52 vars in 829 bytes} [Thu Jul 14 14:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:34:39.039858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:39.123376 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760ce2-fd94-4106-ab89-f06f0d6791cb service cinder] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:39.130764 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:39.132555 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:39.133391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:39.134109 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] PATH_INFO: `/v3/users/4932264e76f046e4b03fe8865fe81b60` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:39.136307 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4932264e76f046e4b03fe8865fe81b60)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:39.137694 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:39.137694 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:34:39.137694 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:34:39.139324 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:39.235470 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4932264e76f046e4b03fe8865fe81b60'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:39.236307 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4932264e76f046e4b03fe8865fe81b60'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:39.249778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4932264e76f046e4b03fe8865fe81b60'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:39.274137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4932264e76f046e4b03fe8865fe81b60'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:39.275667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4932264e76f046e4b03fe8865fe81b60'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:39.285362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:39.308790 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 564/1124] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jul 14 14:34:39 2022] DELETE /identity/v3/users/4932264e76f046e4b03fe8865fe81b60 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:34:39.313795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:39.314092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:39.314377 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:39.343952 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:34:39.346064 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:39.442062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 561/1125] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:34:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:34:39.453826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:39.455778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:39.546945 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fca69-0eb7-488b-9c5d-29483e79a61e admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:39.550788 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24955d1-eaa8-4798-a9f1-52efe5bd6dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:39.551513 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24955d1-eaa8-4798-a9f1-52efe5bd6dbf service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:39.551789 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24955d1-eaa8-4798-a9f1-52efe5bd6dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:39.552065 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24955d1-eaa8-4798-a9f1-52efe5bd6dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:39.564979 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24955d1-eaa8-4798-a9f1-52efe5bd6dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:39.566452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24955d1-eaa8-4798-a9f1-52efe5bd6dbf service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:39.578362 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 565/1126] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:34:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:34:40.061274 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:34:40.063956 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:34:40.088224 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b2d80-2c79-45d8-9787-51f0e845a6de None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:34:40.094900 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] PATH_INFO: `/v3/projects/f106b66d75df47c8a93da68f32f022ab` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f106b66d75df47c8a93da68f32f022ab)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:34:40.101754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:34:40.104144 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:34:40.192142 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f106b66d75df47c8a93da68f32f022ab', 'request_id': 'req-fe25705c-a83d-41eb-9668-7bb9c156fc00'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:40.197761 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:40.200716 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f106b66d75df47c8a93da68f32f022ab', 'request_id': 'req-fe25705c-a83d-41eb-9668-7bb9c156fc00'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:40.215705 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f106b66d75df47c8a93da68f32f022ab', 'request_id': 'req-fe25705c-a83d-41eb-9668-7bb9c156fc00'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:40.239310 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] The token cache is being invalidate because project f106b66d75df47c8a93da68f32f022ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87185) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:34:40.239600 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:40.240431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-fe25705c-a83d-41eb-9668-7bb9c156fc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:34:40.242132 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 562/1127] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:40 2022] DELETE /identity/v3/projects/f106b66d75df47c8a93da68f32f022ab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:34:49.573166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=29 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:50.235331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:08.975248 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e78a-ce1e-4fc0-aa2a-be90dc85eca3 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.976150 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e78a-ce1e-4fc0-aa2a-be90dc85eca3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.976321 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e78a-ce1e-4fc0-aa2a-be90dc85eca3 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:08.978490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:36:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:08.986467 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e08a-b7a3-4d3c-8281-38f0eb622659 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:08.987418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e08a-b7a3-4d3c-8281-38f0eb622659 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:08.987418 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e08a-b7a3-4d3c-8281-38f0eb622659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.019433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-6545e08a-b7a3-4d3c-8281-38f0eb622659 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:09.022638 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-6545e08a-b7a3-4d3c-8281-38f0eb622659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.124777 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:36:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:09.302062 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e78a-ce1e-4fc0-aa2a-be90dc85eca3 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:09.305052 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-d2d0e78a-ce1e-4fc0-aa2a-be90dc85eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:09.458003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e78a-ce1e-4fc0-aa2a-be90dc85eca3 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:09.466664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb1d4f-1786-4bfd-862d-2ef44606b74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:09.467856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1d4f-1786-4bfd-862d-2ef44606b74b service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:09.468250 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1d4f-1786-4bfd-862d-2ef44606b74b service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:09.468709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1d4f-1786-4bfd-862d-2ef44606b74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:09.484286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb1d4f-1786-4bfd-862d-2ef44606b74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:09.486308 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb1d4f-1786-4bfd-862d-2ef44606b74b service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:09.500929 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 567/1130] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:10.437494 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b737b3-1299-463c-980f-62b969781ec5 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.438208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b737b3-1299-463c-980f-62b969781ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.438350 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b737b3-1299-463c-980f-62b969781ec5 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.440894 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:36:10.449335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa514-7652-4ae2-a543-f52486c3d995 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.449936 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa514-7652-4ae2-a543-f52486c3d995 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.450326 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa514-7652-4ae2-a543-f52486c3d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.482245 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-7b4aa514-7652-4ae2-a543-f52486c3d995 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:10.484930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-7b4aa514-7652-4ae2-a543-f52486c3d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:10.499646 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:36:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:10.759751 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b737b3-1299-463c-980f-62b969781ec5 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:10.777478 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b737b3-1299-463c-980f-62b969781ec5 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:10.784863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818247-e861-48b1-aa77-00ade7f4038c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:10.784863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818247-e861-48b1-aa77-00ade7f4038c service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:10.784863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818247-e861-48b1-aa77-00ade7f4038c service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:10.784863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818247-e861-48b1-aa77-00ade7f4038c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:10.795351 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818247-e861-48b1-aa77-00ade7f4038c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:10.796996 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818247-e861-48b1-aa77-00ade7f4038c service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:10.812003 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 565/1133] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:36:14.082157 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3b87-87e8-49b8-a8e5-a0dbd79d0453 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.082802 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3b87-87e8-49b8-a8e5-a0dbd79d0453 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.083214 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3b87-87e8-49b8-a8e5-a0dbd79d0453 None None] PATH_INFO: `/v3` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.086357 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 569/1134] 10.222.0.105 () {54 vars in 926 bytes} [Thu Jul 14 14:36:14 2022] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 14:36:14.092656 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619ce1-a8f9-4fe0-b068-7bc55a421cc6 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:14.093502 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619ce1-a8f9-4fe0-b068-7bc55a421cc6 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:14.093502 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619ce1-a8f9-4fe0-b068-7bc55a421cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:14.124557 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-90619ce1-a8f9-4fe0-b068-7bc55a421cc6 None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:14.127241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-90619ce1-a8f9-4fe0-b068-7bc55a421cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:14.234335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 566/1135] 10.222.0.105 () {58 vars in 1016 bytes} [Thu Jul 14 14:36:14 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:20.473975 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=40 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.218409 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c31aa-f526-4092-b7cb-1a50015f3df3 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.219992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c31aa-f526-4092-b7cb-1a50015f3df3 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.219992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c31aa-f526-4092-b7cb-1a50015f3df3 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.221330 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:22.227880 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827a72-c892-4a24-85d3-c6f46b280c74 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.228460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827a72-c892-4a24-85d3-c6f46b280c74 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.228460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827a72-c892-4a24-85d3-c6f46b280c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.252917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-20827a72-c892-4a24-85d3-c6f46b280c74 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:22.252917 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-20827a72-c892-4a24-85d3-c6f46b280c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:22.261058 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:36:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:22.433814 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c31aa-f526-4092-b7cb-1a50015f3df3 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:22.448809 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c31aa-f526-4092-b7cb-1a50015f3df3 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:22.454404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eccd0-07eb-42af-b43f-cd18c5ec6b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:22.455104 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eccd0-07eb-42af-b43f-cd18c5ec6b0c service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:22.455388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eccd0-07eb-42af-b43f-cd18c5ec6b0c service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:22.455665 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eccd0-07eb-42af-b43f-cd18c5ec6b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:22.465815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eccd0-07eb-42af-b43f-cd18c5ec6b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:22.467538 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eccd0-07eb-42af-b43f-cd18c5ec6b0c service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:22.478793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 571/1138] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:23.309958 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2110-bcea-4cdd-97cf-83a7b4cd2967 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.310606 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2110-bcea-4cdd-97cf-83a7b4cd2967 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.311106 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2110-bcea-4cdd-97cf-83a7b4cd2967 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.314221 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 568/1139] 10.222.0.65 () {54 vars in 960 bytes} [Thu Jul 14 14:36:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:23.321142 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb963e-b4f8-468c-a5ac-5c76789913b1 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.322007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb963e-b4f8-468c-a5ac-5c76789913b1 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.322007 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb963e-b4f8-468c-a5ac-5c76789913b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.341896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-47cb963e-b4f8-468c-a5ac-5c76789913b1 None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:23.343355 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-47cb963e-b4f8-468c-a5ac-5c76789913b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.352708 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 572/1140] 10.222.0.65 () {58 vars in 1057 bytes} [Thu Jul 14 14:36:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:36:23.361143 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2110-bcea-4cdd-97cf-83a7b4cd2967 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:23.380635 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2110-bcea-4cdd-97cf-83a7b4cd2967 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:23.388709 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:23.389750 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.390177 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.390596 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.404016 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64cdb-2578-497b-88dc-5c60690181b7 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.404317 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:23.404461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64cdb-2578-497b-88dc-5c60690181b7 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.404798 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64cdb-2578-497b-88dc-5c60690181b7 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.405961 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:23.407065 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 573/1141] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 14:36:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:36:23.414732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c173a4-7890-4894-899f-ff72ceb7b461 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.415201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c173a4-7890-4894-899f-ff72ceb7b461 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.415608 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c173a4-7890-4894-899f-ff72ceb7b461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.417560 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 569/1142] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:23.444634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-d9c173a4-7890-4894-899f-ff72ceb7b461 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:23.447033 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-d9c173a4-7890-4894-899f-ff72ceb7b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:23.456578 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 14:36:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:36:23.631419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:23.647105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603062-8b70-4508-8b9b-14dbd68334f3 service placement] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:23.654908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e239e-00f9-4f57-bd5c-2da9beb00773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:23.656098 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e239e-00f9-4f57-bd5c-2da9beb00773 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:23.656543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e239e-00f9-4f57-bd5c-2da9beb00773 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:23.657033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e239e-00f9-4f57-bd5c-2da9beb00773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:23.673911 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e239e-00f9-4f57-bd5c-2da9beb00773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:23.677051 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e239e-00f9-4f57-bd5c-2da9beb00773 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:23.695483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 570/1144] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:28.324360 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e79b8-5967-4d9d-b67c-555095d679b8 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.325030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e79b8-5967-4d9d-b67c-555095d679b8 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.325030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e79b8-5967-4d9d-b67c-555095d679b8 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.326448 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:28.333184 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca59e7-2245-43c8-865e-476444d22bc9 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.333888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca59e7-2245-43c8-865e-476444d22bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.333888 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca59e7-2245-43c8-865e-476444d22bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.353372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-ceca59e7-2245-43c8-865e-476444d22bc9 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:28.354614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-ceca59e7-2245-43c8-865e-476444d22bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:28.362839 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:36:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:28.406330 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e79b8-5967-4d9d-b67c-555095d679b8 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:28.408179 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-754e79b8-5967-4d9d-b67c-555095d679b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:28.496294 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e79b8-5967-4d9d-b67c-555095d679b8 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:28.500651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57983-1f36-4389-a74e-67a9380e197f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:28.501460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57983-1f36-4389-a74e-67a9380e197f service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:28.501860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57983-1f36-4389-a74e-67a9380e197f service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:28.502234 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57983-1f36-4389-a74e-67a9380e197f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:28.513750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f57983-1f36-4389-a74e-67a9380e197f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:28.515256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f57983-1f36-4389-a74e-67a9380e197f service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:28.527653 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 576/1147] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:31.016777 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6ee15-b3a2-4d8b-97de-b1dda727871f None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.017400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6ee15-b3a2-4d8b-97de-b1dda727871f None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.017400 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6ee15-b3a2-4d8b-97de-b1dda727871f None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.018747 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 572/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:31.025373 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ceaf-7201-4330-860e-593a11fdf21c None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.026183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ceaf-7201-4330-860e-593a11fdf21c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.026183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ceaf-7201-4330-860e-593a11fdf21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.048286 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-7289ceaf-7201-4330-860e-593a11fdf21c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:31.050528 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-7289ceaf-7201-4330-860e-593a11fdf21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:31.062216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 577/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:36:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:31.102102 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6ee15-b3a2-4d8b-97de-b1dda727871f None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:31.108540 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=81 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:31.115942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6ee15-b3a2-4d8b-97de-b1dda727871f None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:31.120101 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634145-f33a-4066-9ca1-11e0f1fa4158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:31.120821 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634145-f33a-4066-9ca1-11e0f1fa4158 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:31.121155 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634145-f33a-4066-9ca1-11e0f1fa4158 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:31.121495 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634145-f33a-4066-9ca1-11e0f1fa4158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:31.133011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3634145-f33a-4066-9ca1-11e0f1fa4158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:31.134502 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3634145-f33a-4066-9ca1-11e0f1fa4158 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:31.146512 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 573/1150] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:35.287860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a32d6-ddf5-4a20-a791-50ce13d0516f None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.288697 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a32d6-ddf5-4a20-a791-50ce13d0516f None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.288860 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a32d6-ddf5-4a20-a791-50ce13d0516f None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.290384 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 578/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:35.296667 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f881c-c274-4868-bb29-af3afdf5af0c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.297289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f881c-c274-4868-bb29-af3afdf5af0c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.297463 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f881c-c274-4868-bb29-af3afdf5af0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.318192 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5e9f881c-c274-4868-bb29-af3afdf5af0c None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:35.319470 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5e9f881c-c274-4868-bb29-af3afdf5af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:35.328699 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 574/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:36:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:36:35.727001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a32d6-ddf5-4a20-a791-50ce13d0516f None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:35.728864 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-808a32d6-ddf5-4a20-a791-50ce13d0516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:35.851941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a32d6-ddf5-4a20-a791-50ce13d0516f None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:35.858078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05bc3-7763-4bd0-a2c0-5ff267ba6753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8b686560994350b28cd4c6016b4fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:35.859328 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05bc3-7763-4bd0-a2c0-5ff267ba6753 service cinder] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:35.859821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05bc3-7763-4bd0-a2c0-5ff267ba6753 service cinder] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:35.860318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05bc3-7763-4bd0-a2c0-5ff267ba6753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:35.878212 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e05bc3-7763-4bd0-a2c0-5ff267ba6753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:35.881854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e05bc3-7763-4bd0-a2c0-5ff267ba6753 service cinder] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:35.900964 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 579/1153] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:38.434907 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfcf7f-62d2-4434-bf4c-259b3d40a0a6 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.435595 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfcf7f-62d2-4434-bf4c-259b3d40a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.435595 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfcf7f-62d2-4434-bf4c-259b3d40a0a6 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.436893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 575/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 14:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:36:38.443536 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2851-9e25-4f3f-a4e5-6769a8c02f47 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.444445 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2851-9e25-4f3f-a4e5-6769a8c02f47 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.444761 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2851-9e25-4f3f-a4e5-6769a8c02f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.465935 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-bc7e2851-9e25-4f3f-a4e5-6769a8c02f47 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:36:38.467547 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-bc7e2851-9e25-4f3f-a4e5-6769a8c02f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:38.482472 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 580/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 14:36:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:36:38.807619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfcf7f-62d2-4434-bf4c-259b3d40a0a6 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:36:38.809756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-fecfcf7f-62d2-4434-bf4c-259b3d40a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:36:38.828010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfcf7f-62d2-4434-bf4c-259b3d40a0a6 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:36:38.835904 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83940dc4-3012-4c76-9737-ee1b23b824c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8b686560994350b28cd4c6016b4fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:36:38.836663 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940dc4-3012-4c76-9737-ee1b23b824c1 service cinder] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:36:38.836960 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940dc4-3012-4c76-9737-ee1b23b824c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:36:38.837235 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940dc4-3012-4c76-9737-ee1b23b824c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:36:38.850431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83940dc4-3012-4c76-9737-ee1b23b824c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:36:38.852785 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83940dc4-3012-4c76-9737-ee1b23b824c1 service cinder] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:36:38.866013 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 576/1156] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:36:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:48.460049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=80 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:48.860010 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=14 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:05.855704 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927ba12-dfab-4724-b19b-ceb8dd3a4bff None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.856743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927ba12-dfab-4724-b19b-ceb8dd3a4bff None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.856743 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927ba12-dfab-4724-b19b-ceb8dd3a4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.861413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb40b6-5e55-4733-bb19-a7b326a2c6fe None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.862854 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb40b6-5e55-4733-bb19-a7b326a2c6fe None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.863643 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb40b6-5e55-4733-bb19-a7b326a2c6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.886583 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-1927ba12-dfab-4724-b19b-ceb8dd3a4bff None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:05.888345 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-0fcb40b6-5e55-4733-bb19-a7b326a2c6fe None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:05.888934 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-1927ba12-dfab-4724-b19b-ceb8dd3a4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:05.889835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-0fcb40b6-5e55-4733-bb19-a7b326a2c6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:05.898901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 577/1157] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:05.903967 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 581/1158] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:05.908608 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.909662 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.910048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.914619 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.915277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.915770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.933501 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:05.935429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:05.946470 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:05.951722 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 578/1159] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:05.952029 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:05.954043 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:05.962283 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 582/1160] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:05.967607 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:05.968768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95b6db-9bb4-47ec-9ddf-73d3d7c9b702 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.976968 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.977901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.978297 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.978746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.980076 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87185) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:05.980519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.983486 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:05.984372 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb76b5-b5a2-43e3-bb41-d93f66ecf3db None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:05.993177 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:05.994265 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:05.994722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:05.995214 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:05.996515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 14:38:05.996941 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:05.998573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:05.998573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:38:05.998573 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:38:06.000215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.007778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 579/1161] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:06.016512 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.019364 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 583/1162] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jul 14 14:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 14:38:06.028205 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d924-1e85-4686-ac94-c1c5722253e3 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.033257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.033491 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.034481 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.034759 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.035075 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.035784 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.036848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:06.036848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:38:06.036848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:38:06.038047 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.053389 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d22ba6-cf93-4b96-93b1-1845ca823aaa admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.059664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.060335 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.060629 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.060884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.061589 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.063581 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.074441 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 580/1163] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:06.079028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.101868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 584/1164] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:06.103858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.178028 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be843e-bab6-465a-a7fc-6e3695d7ebfc admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.198290 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8dcc9-d13c-4860-92d9-be75f15dba00 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.205521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.206568 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.207041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.207521 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.208766 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.210615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:06.210615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:38:06.210615 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:38:06.212890 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.242793 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 585/1165] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:06.251666 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.265493 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac4eba-ff36-4f7e-97c3-923a7cfeae37 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.271928 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.272774 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.273191 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.273614 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.274829 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.276821 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.277636 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.278475 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.278934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.279419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.280547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.284619 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.295757 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 586/1166] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:06.301664 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.318748 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 581/1167] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:06.319172 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34d26-7cb9-46dd-b103-faf8c5fdfe1f admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.323471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.324970 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.325800 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.326257 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.326643 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.327563 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.329268 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.337460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffbbb3-7cad-415a-ac31-09f8d8c7e1a9 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.343516 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.344337 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.344718 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.345239 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.345440 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 587/1168] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:06.347395 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.350908 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.352138 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.365248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 582/1169] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:06.365571 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623828-1db0-42f3-9382-4bbb34b986b2 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.369597 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.372003 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa722-81ef-4c3e-af6d-23142600ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.373097 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa722-81ef-4c3e-af6d-23142600ce5a admin admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.373507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa722-81ef-4c3e-af6d-23142600ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.373898 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa722-81ef-4c3e-af6d-23142600ce5a admin admin] PATH_INFO: `/v3/projects/e907a2fa1e3947b4bb3ee6afe633a839/users/bd787e0ad3b4482c8620b0c87b508ebf/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.383323 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79f750-000f-451e-b077-ee6113787c67 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.389288 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.390160 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.390519 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.390934 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.391980 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.394711 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.395727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa722-81ef-4c3e-af6d-23142600ce5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e907a2fa1e3947b4bb3ee6afe633a839, user_id=bd787e0ad3b4482c8620b0c87b508ebf, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.399188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa722-81ef-4c3e-af6d-23142600ce5a admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.415092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 583/1170] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:06.416988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.419836 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 588/1171] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:06 2022] PUT /identity/v3/projects/e907a2fa1e3947b4bb3ee6afe633a839/users/bd787e0ad3b4482c8620b0c87b508ebf/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:06.429282 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.429633 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.430085 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.436512 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71b533-e043-47cb-9321-4c7f9dec4115 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.459313 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:06.461054 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:06.480433 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:06.526424 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.527394 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.527687 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.527966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] PATH_INFO: `/v3/projects/53fc50918b084f7b9b034f7a9f87704b/users/fb9b3a0f88d1457faf922a043b88f892/roles/b248cf9aa90748efa3988f7d7548bc4a` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.536754 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:06.553577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fc50918b084f7b9b034f7a9f87704b, user_id=fb9b3a0f88d1457faf922a043b88f892, role_id=b248cf9aa90748efa3988f7d7548bc4a)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.554719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:06.554719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:38:06.554719 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:38:06.557241 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c38a7e-e420-4ed8-9a3f-23fa90b2e0e5 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.566865 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 589/1172] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:06.579183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.581242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:06.585320 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 584/1173] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:06 2022] PUT /identity/v3/projects/53fc50918b084f7b9b034f7a9f87704b/users/fb9b3a0f88d1457faf922a043b88f892/roles/b248cf9aa90748efa3988f7d7548bc4a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:06.590746 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.591099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.591351 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.615048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] MFA Rules not processed for user `186dc468057544fb86abd90933430e96`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:06.617070 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:06.663682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a237b-27ff-4204-8432-af1d136a1c91 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.710744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 585/1174] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:06.723156 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:06.726965 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95123c8-953d-45dc-8d15-02c907e5ea91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.727669 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95123c8-953d-45dc-8d15-02c907e5ea91 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.727949 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95123c8-953d-45dc-8d15-02c907e5ea91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.728221 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95123c8-953d-45dc-8d15-02c907e5ea91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.735220 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8b5a3-bd7c-4199-a7ca-64415e500113 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:06.740776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf3da-e1c2-4655-b4ed-d90c7ebeb609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:06.741061 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95123c8-953d-45dc-8d15-02c907e5ea91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.741577 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf3da-e1c2-4655-b4ed-d90c7ebeb609 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:06.742074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf3da-e1c2-4655-b4ed-d90c7ebeb609 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:06.742420 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf3da-e1c2-4655-b4ed-d90c7ebeb609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:06.743883 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95123c8-953d-45dc-8d15-02c907e5ea91 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.754419 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf3da-e1c2-4655-b4ed-d90c7ebeb609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:06.755921 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf3da-e1c2-4655-b4ed-d90c7ebeb609 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:06.762017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 590/1175] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:06.767239 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 586/1176] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:15.668256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:15.668955 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:15.669216 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:15.719240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] MFA Rules not processed for user `bd787e0ad3b4482c8620b0c87b508ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:15.720788 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:15.721889 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:15.722323 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:15.723417 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:15.779202 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:15.781553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:15.816293 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 591/1177] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:15 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:15.822824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:15.835613 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aea2d7-0199-4a8d-ae9d-01e00b7d11f5 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:15.841559 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:15.842264 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:15.842710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:15.842874 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] PATH_INFO: `/v3/projects` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:15.843687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:15.845800 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:15.881807 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 592/1178] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:15 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 14:38:15.887651 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:15.925277 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 587/1179] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:15 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:15.927361 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:15.944453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41592f1-4492-432b-a555-4218171f7b3a None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:15.964394 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:15.997153 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:16.063543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.064543 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.065159 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.065796 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] PATH_INFO: `/v3/projects` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.066892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.069273 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.094665 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73163-b6da-42ec-8dec-04b61c27f652 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.114770 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.115992 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.116668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.117168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] PATH_INFO: `/v3/users` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.118163 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.120376 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.122381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 588/1180] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jul 14 14:38:15 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:16.126753 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.169229 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 593/1181] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:15 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:16.171660 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.186503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655d1fb-7128-47c9-8549-464ce165a122 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.233541 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdf73f-3df2-4df5-a9fc-dce11baef388 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.244536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.244536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.244536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.244536 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] PATH_INFO: `/v3/users` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.246174 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.247778 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.278882 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 589/1182] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jul 14 14:38:16 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 14:38:16.283275 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.300863 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1818-11f7-4e39-8fdf-e6c007dc7d58 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.308496 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.309408 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.309807 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.310190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.311109 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.313248 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.314377 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.316675 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.317166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.318231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.319081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.322044 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.329231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 590/1183] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 14:38:16.334943 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.342119 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 594/1184] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:16.349100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.353114 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c834-bfeb-4ade-a70d-c3307d14a12b admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.362805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.364366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.364931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.365483 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] PATH_INFO: `/v3/projects/c7c3952486854b3c9f7d3923355cde64/users/149046fabf544e5aaafa8b9d5a3764cb/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.367962 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a03d3-0615-4ea8-9c65-586e4ce9f173 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.376943 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.380058 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.380535 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.380998 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] PATH_INFO: `/v3/projects/b7dc8b60e0d94d2a921056e89891221a/users/d38d0860ae29454292d5761de68feb55/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.395096 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c3952486854b3c9f7d3923355cde64, user_id=149046fabf544e5aaafa8b9d5a3764cb, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.400066 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.411408 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dc8b60e0d94d2a921056e89891221a, user_id=d38d0860ae29454292d5761de68feb55, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.417801 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.435335 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 591/1185] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:16 2022] PUT /identity/v3/projects/c7c3952486854b3c9f7d3923355cde64/users/149046fabf544e5aaafa8b9d5a3764cb/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:16.437238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.508918 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 595/1186] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:16 2022] PUT /identity/v3/projects/b7dc8b60e0d94d2a921056e89891221a/users/d38d0860ae29454292d5761de68feb55/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:16.517201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.642162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6b5f9-895c-49d5-98b0-faa2a4e406e6 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.663913 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:16.695825 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f618f-158d-4862-bbf2-78b6119a075f admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.703750 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.704923 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.705251 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.705884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] PATH_INFO: `/v3/roles` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.706321 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.708956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.743252 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 596/1187] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:16.746815 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.768963 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eb189-16f3-4799-8356-30de2715c143 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.775824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.776926 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.777252 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f67fa-650e-4cce-879c-0e3331128d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.777472 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.777634 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.779355 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.779578 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f67fa-650e-4cce-879c-0e3331128d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.779578 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f67fa-650e-4cce-879c-0e3331128d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.780279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.781948 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f67fa-650e-4cce-879c-0e3331128d1f admin admin] PATH_INFO: `/v3/projects/b7dc8b60e0d94d2a921056e89891221a/users/d38d0860ae29454292d5761de68feb55/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.786525 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f67fa-650e-4cce-879c-0e3331128d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dc8b60e0d94d2a921056e89891221a, user_id=d38d0860ae29454292d5761de68feb55, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.791832 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f67fa-650e-4cce-879c-0e3331128d1f admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.795089 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 592/1188] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jul 14 14:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 14:38:16.800261 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:16.812116 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3678-78a3-4f97-bba6-4867c65f82a2 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:16.813331 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 597/1189] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:16 2022] PUT /identity/v3/projects/b7dc8b60e0d94d2a921056e89891221a/users/d38d0860ae29454292d5761de68feb55/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:38:16.925085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:16.926825 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] REQUEST_METHOD: `PUT` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:16.927447 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:16.927832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] PATH_INFO: `/v3/projects/c7c3952486854b3c9f7d3923355cde64/users/149046fabf544e5aaafa8b9d5a3764cb/roles/b54c08538cf74f1e83a40ae268cfccfa` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:16.930333 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c3952486854b3c9f7d3923355cde64, user_id=149046fabf544e5aaafa8b9d5a3764cb, role_id=b54c08538cf74f1e83a40ae268cfccfa)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:16.934366 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:16.964453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 593/1190] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jul 14 14:38:16 2022] PUT /identity/v3/projects/c7c3952486854b3c9f7d3923355cde64/users/149046fabf544e5aaafa8b9d5a3764cb/roles/b54c08538cf74f1e83a40ae268cfccfa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:38:26.097195 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d9a3-9ec2-453e-b30b-6997815ab331 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.098008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d9a3-9ec2-453e-b30b-6997815ab331 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.098008 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d9a3-9ec2-453e-b30b-6997815ab331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.117261 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:26.140078 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-62d3d9a3-9ec2-453e-b30b-6997815ab331 None None] MFA Rules not processed for user `d38d0860ae29454292d5761de68feb55`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:26.143740 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-62d3d9a3-9ec2-453e-b30b-6997815ab331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.302595 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 598/1191] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:26 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:26.320469 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:26.323742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.518507 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.519826 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.521396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.589123 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] MFA Rules not processed for user `149046fabf544e5aaafa8b9d5a3764cb`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:26.590818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.600756 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59561-d1da-4c51-b575-24a8e4c27273 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:26.612401 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f44f5d-8526-4c08-8892-97da736d3f4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02274dd74048403fa814884ad73c7ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:26.613992 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f44f5d-8526-4c08-8892-97da736d3f4b service glance] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.614875 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f44f5d-8526-4c08-8892-97da736d3f4b service glance] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.615636 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f44f5d-8526-4c08-8892-97da736d3f4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:26.759231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:26.763339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 599/1192] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:26 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:26.789310 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:26.790181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f44f5d-8526-4c08-8892-97da736d3f4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:26.792255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:26.793298 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f44f5d-8526-4c08-8892-97da736d3f4b service glance] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:26.817833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 594/1193] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:26 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:26.821661 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64148ef-ff41-40d4-b616-eb91a2de2c0b None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:26.833314 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f946-3c67-4c14-b20e-d5ba0350128f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02274dd74048403fa814884ad73c7ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:26.834863 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f946-3c67-4c14-b20e-d5ba0350128f service glance] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:26.835452 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f946-3c67-4c14-b20e-d5ba0350128f service glance] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:26.835914 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f946-3c67-4c14-b20e-d5ba0350128f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:27.000242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f946-3c67-4c14-b20e-d5ba0350128f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:27.005994 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f946-3c67-4c14-b20e-d5ba0350128f service glance] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:27.031100 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 600/1194] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:26 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:36.804255 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=6 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:37.021041 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=93 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:37.418134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a5ce-5282-4ace-a5ed-fe452bbc4bc2 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:37.418510 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a5ce-5282-4ace-a5ed-fe452bbc4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:37.418962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a5ce-5282-4ace-a5ed-fe452bbc4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:37.452314 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-fa52a5ce-5282-4ace-a5ed-fe452bbc4bc2 None None] MFA Rules not processed for user `bd787e0ad3b4482c8620b0c87b508ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:37.453893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-fa52a5ce-5282-4ace-a5ed-fe452bbc4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:37.463162 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 595/1195] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:38:37 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:38.017035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fb6b-defd-4222-9e6a-5aed210248ea None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.017530 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fb6b-defd-4222-9e6a-5aed210248ea None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.019534 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fb6b-defd-4222-9e6a-5aed210248ea None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.023325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 601/1196] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jul 14 14:38:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:38.029554 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410cbd-6389-4f33-8fa0-9ac6f76c82a1 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.030893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410cbd-6389-4f33-8fa0-9ac6f76c82a1 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.031805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410cbd-6389-4f33-8fa0-9ac6f76c82a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.072331 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-4a410cbd-6389-4f33-8fa0-9ac6f76c82a1 None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:38.074151 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-4a410cbd-6389-4f33-8fa0-9ac6f76c82a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.165023 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 596/1197] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jul 14 14:38:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:38.172700 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595348cd-3883-4bfd-a4c4-cc68554eb8ca None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.173015 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595348cd-3883-4bfd-a4c4-cc68554eb8ca None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.173298 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595348cd-3883-4bfd-a4c4-cc68554eb8ca None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.176990 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 602/1198] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jul 14 14:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:38.185594 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074cf8c-de05-4b15-a214-fbab330bf573 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.186209 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074cf8c-de05-4b15-a214-fbab330bf573 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.186618 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074cf8c-de05-4b15-a214-fbab330bf573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.210566 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-9074cf8c-de05-4b15-a214-fbab330bf573 None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:38.212115 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-9074cf8c-de05-4b15-a214-fbab330bf573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.227318 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 597/1199] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jul 14 14:38:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:38.236479 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595348cd-3883-4bfd-a4c4-cc68554eb8ca None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:38.251567 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595348cd-3883-4bfd-a4c4-cc68554eb8ca None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:38.257722 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a101bb-79ad-4b32-9caa-aa60001601fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02274dd74048403fa814884ad73c7ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:38.258406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a101bb-79ad-4b32-9caa-aa60001601fd service glance] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.258693 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a101bb-79ad-4b32-9caa-aa60001601fd service glance] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.259001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a101bb-79ad-4b32-9caa-aa60001601fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.271188 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a101bb-79ad-4b32-9caa-aa60001601fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:38.273594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a101bb-79ad-4b32-9caa-aa60001601fd service glance] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:38.289896 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 603/1200] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:38.857251 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8059-1cb5-4575-9316-80f8a9ac8ff7 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.857824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8059-1cb5-4575-9316-80f8a9ac8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.858112 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8059-1cb5-4575-9316-80f8a9ac8ff7 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.859614 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 598/1201] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jul 14 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:38.865824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06b95-7e49-44d8-ad5b-bfc5aba5c243 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:38.866121 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06b95-7e49-44d8-ad5b-bfc5aba5c243 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:38.866414 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06b95-7e49-44d8-ad5b-bfc5aba5c243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:38.888289 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-eaa06b95-7e49-44d8-ad5b-bfc5aba5c243 None None] MFA Rules not processed for user `22fcac88391d48e1a19591ab0ac05210`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:38.889849 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-eaa06b95-7e49-44d8-ad5b-bfc5aba5c243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:38.971383 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 604/1202] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jul 14 14:38:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:38.983655 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8059-1cb5-4575-9316-80f8a9ac8ff7 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:38.996559 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8059-1cb5-4575-9316-80f8a9ac8ff7 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.000639 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd6eb-e38f-4323-9c22-0970eb20c88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.001307 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd6eb-e38f-4323-9c22-0970eb20c88d service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.001616 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd6eb-e38f-4323-9c22-0970eb20c88d service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.001887 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd6eb-e38f-4323-9c22-0970eb20c88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.012052 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fd6eb-e38f-4323-9c22-0970eb20c88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.013532 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fd6eb-e38f-4323-9c22-0970eb20c88d service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.024413 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 599/1203] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:38 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:39.638272 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ee54-a532-49f3-a850-5cb678579165 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.638858 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ee54-a532-49f3-a850-5cb678579165 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.639549 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ee54-a532-49f3-a850-5cb678579165 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.642375 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 605/1204] 10.222.0.65 () {54 vars in 960 bytes} [Thu Jul 14 14:38:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:39.650373 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507b99-dfb4-46b4-b161-6ff289af63e4 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.651252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507b99-dfb4-46b4-b161-6ff289af63e4 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.651537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507b99-dfb4-46b4-b161-6ff289af63e4 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.654187 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 600/1205] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jul 14 14:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:39.654566 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.655030 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.655496 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.666565 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2099152-9a59-48fe-bf2a-5a2179f3b39b None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.667551 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2099152-9a59-48fe-bf2a-5a2179f3b39b None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.668037 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2099152-9a59-48fe-bf2a-5a2179f3b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.698432 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-d2099152-9a59-48fe-bf2a-5a2179f3b39b None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:39.699763 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-d2099152-9a59-48fe-bf2a-5a2179f3b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:39.710920 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 601/1206] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jul 14 14:38:39 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:39.712275 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:39.714358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:39.716505 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f448dd-81c0-4c83-b3f0-eb8036a11be1 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.716787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f448dd-81c0-4c83-b3f0-eb8036a11be1 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.717073 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f448dd-81c0-4c83-b3f0-eb8036a11be1 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.724847 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 602/1207] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jul 14 14:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:38:39.730099 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.730374 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.730655 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.750902 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:39.753220 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:39.764505 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 603/1208] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jul 14 14:38:39 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:38:39.778760 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.793772 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f82b-84ef-4ad0-81fa-22b4317be8f7 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.799856 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc50613-443c-47b2-9ed8-cfec12b7d14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.800885 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50613-443c-47b2-9ed8-cfec12b7d14b service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.801309 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50613-443c-47b2-9ed8-cfec12b7d14b service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.801749 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50613-443c-47b2-9ed8-cfec12b7d14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.818460 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50613-443c-47b2-9ed8-cfec12b7d14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.821016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50613-443c-47b2-9ed8-cfec12b7d14b service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.834575 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 606/1209] 10.222.0.65 () {58 vars in 1057 bytes} [Thu Jul 14 14:38:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:39.843399 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 604/1210] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:38:39.849805 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:39.869137 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45cf6b-5388-48ba-8f42-dd16686593c9 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:39.882388 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:39.884363 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:39.885099 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:39.886068 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:39.889568 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:39.918009 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:39.921326 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:39.942696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 607/1211] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:49.832987 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=53 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:49.937056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=69 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:50.649817 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d086d03-cc5d-4240-bffa-609e5972631d None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:50.650227 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d086d03-cc5d-4240-bffa-609e5972631d None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:50.650515 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d086d03-cc5d-4240-bffa-609e5972631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:50.672193 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-5d086d03-cc5d-4240-bffa-609e5972631d None None] MFA Rules not processed for user `22fcac88391d48e1a19591ab0ac05210`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:50.673436 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-5d086d03-cc5d-4240-bffa-609e5972631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:50.680861 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 605/1212] 10.222.0.105 () {58 vars in 1016 bytes} [Thu Jul 14 14:38:50 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:50.701035 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:50.716164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afdb2f-7c59-472e-81ca-4538a2c8f54f service placement] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:50.722599 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b980334-1c90-47ac-8495-104046a334f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:50.723936 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980334-1c90-47ac-8495-104046a334f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:50.724396 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980334-1c90-47ac-8495-104046a334f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:50.724862 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980334-1c90-47ac-8495-104046a334f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:50.738659 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b980334-1c90-47ac-8495-104046a334f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:50.740505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b980334-1c90-47ac-8495-104046a334f5 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:50.750407 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 608/1213] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:50 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:52.020885 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034398fa-b46c-4b37-bce9-3cb280153ac2 None None] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.021530 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034398fa-b46c-4b37-bce9-3cb280153ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.021912 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034398fa-b46c-4b37-bce9-3cb280153ac2 None None] PATH_INFO: `/` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.024990 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 606/1214] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:38:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:52.066444 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673b3c-7025-48bb-8363-849067915d19 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.066444 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673b3c-7025-48bb-8363-849067915d19 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.067561 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673b3c-7025-48bb-8363-849067915d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.108884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-d3673b3c-7025-48bb-8363-849067915d19 None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:52.111749 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-d3673b3c-7025-48bb-8363-849067915d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:52.134108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 609/1215] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:38:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:52.155398 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034398fa-b46c-4b37-bce9-3cb280153ac2 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:52.185253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034398fa-b46c-4b37-bce9-3cb280153ac2 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:52.195584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e53764-107c-4766-9598-c9f45542f10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:52.196698 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53764-107c-4766-9598-c9f45542f10a service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:52.197190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53764-107c-4766-9598-c9f45542f10a service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:52.197672 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53764-107c-4766-9598-c9f45542f10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:52.218534 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e53764-107c-4766-9598-c9f45542f10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:52.222445 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e53764-107c-4766-9598-c9f45542f10a service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:52.245442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 607/1216] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:38:58.517392 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c140c-95cd-4b53-82df-9367e7e68267 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.519277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c140c-95cd-4b53-82df-9367e7e68267 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.519277 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c140c-95cd-4b53-82df-9367e7e68267 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.521098 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 610/1217] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:38:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:38:58.541180 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25d133-0793-492c-8215-468675a9564c None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.541809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25d133-0793-492c-8215-468675a9564c None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.541809 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25d133-0793-492c-8215-468675a9564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.572991 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-2e25d133-0793-492c-8215-468675a9564c None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:38:58.574471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-2e25d133-0793-492c-8215-468675a9564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:38:58.591033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 608/1218] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:38:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:38:58.613884 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c140c-95cd-4b53-82df-9367e7e68267 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:38:58.636526 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c140c-95cd-4b53-82df-9367e7e68267 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:38:58.642220 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc6f69-1dda-454b-8367-547990dcf3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:38:58.643010 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc6f69-1dda-454b-8367-547990dcf3f6 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:38:58.643986 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc6f69-1dda-454b-8367-547990dcf3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:38:58.644164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc6f69-1dda-454b-8367-547990dcf3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:38:58.654713 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc6f69-1dda-454b-8367-547990dcf3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:38:58.657609 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc6f69-1dda-454b-8367-547990dcf3f6 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:38:58.678117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 611/1219] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:38:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:39:08.564499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=12 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:08.664430 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=15 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:11.691105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25d133-0793-492c-8215-468675a9564c None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:11.702368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25d133-0793-492c-8215-468675a9564c None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:11.709429 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c6169-eff1-418a-a994-c3396537d5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:11.710506 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c6169-eff1-418a-a994-c3396537d5db service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:11.711085 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c6169-eff1-418a-a994-c3396537d5db service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:11.711810 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c6169-eff1-418a-a994-c3396537d5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:11.728387 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c6169-eff1-418a-a994-c3396537d5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:11.731095 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c6169-eff1-418a-a994-c3396537d5db service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:11.749443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 609/1220] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:11 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:39:17.535122 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3c55-76df-49d3-97d3-ed6ef880b260 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:17.535709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3c55-76df-49d3-97d3-ed6ef880b260 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:17.535709 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3c55-76df-49d3-97d3-ed6ef880b260 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:17.537545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 612/1221] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:39:17.553279 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80a7d-58cc-424a-aa2e-7afc63714d8f None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:17.554041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80a7d-58cc-424a-aa2e-7afc63714d8f None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:17.554041 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80a7d-58cc-424a-aa2e-7afc63714d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:17.587830 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-53f80a7d-58cc-424a-aa2e-7afc63714d8f None None] MFA Rules not processed for user `a69be22bfe524d48a0f2932f83694f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:17.590993 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-53f80a7d-58cc-424a-aa2e-7afc63714d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:17.641995 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 610/1222] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:39:17 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:39:17.655193 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3c55-76df-49d3-97d3-ed6ef880b260 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:39:17.670270 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3c55-76df-49d3-97d3-ed6ef880b260 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:39:17.678778 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee03eaa-e4f3-4c5c-b0d3-3142d3f6d61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:39:17.679490 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03eaa-e4f3-4c5c-b0d3-3142d3f6d61c service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:17.679765 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03eaa-e4f3-4c5c-b0d3-3142d3f6d61c service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:17.680255 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03eaa-e4f3-4c5c-b0d3-3142d3f6d61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:17.696876 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee03eaa-e4f3-4c5c-b0d3-3142d3f6d61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:39:17.698881 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee03eaa-e4f3-4c5c-b0d3-3142d3f6d61c service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:39:17.712174 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 613/1223] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:39:17 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:39:27.578819 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=9 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:27.707127 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=6 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:42.169407 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe542-bd77-40f2-9575-384dcfddadac None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:39:42.169999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe542-bd77-40f2-9575-384dcfddadac None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:39:42.169999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe542-bd77-40f2-9575-384dcfddadac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:39:42.192708 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-295fe542-bd77-40f2-9575-384dcfddadac None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:39:42.193962 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-295fe542-bd77-40f2-9575-384dcfddadac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:39:42.201428 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 611/1224] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:39:42 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:39:52.184824 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:09.595508 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6576cce-1f4d-4088-ba99-56eae9f5ce7b None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:09.598314 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6576cce-1f4d-4088-ba99-56eae9f5ce7b None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:09.598314 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6576cce-1f4d-4088-ba99-56eae9f5ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:09.623001 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-a6576cce-1f4d-4088-ba99-56eae9f5ce7b None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:09.624320 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-a6576cce-1f4d-4088-ba99-56eae9f5ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:09.632115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 614/1225] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:40:09 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:40:19.616783 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:25.415029 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:40:25.415866 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:40:25.416011 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:40:25.435832 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:40:25.437069 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:40:25.444835 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 612/1226] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:40:25 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:40:35.429549 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:26.410505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:26.411269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:26.411269 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:26.431081 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:41:26.432353 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:41:26.439919 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 615/1227] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:41:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:41:27.899222 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:27.928826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87174a-4bc3-4179-bfbe-dc237c2a8aa7 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:27.934941 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7726d-aa08-4f4b-9904-63587a914c16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:27.935645 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7726d-aa08-4f4b-9904-63587a914c16 service placement] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:27.935999 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7726d-aa08-4f4b-9904-63587a914c16 service placement] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:27.936289 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7726d-aa08-4f4b-9904-63587a914c16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:27.947547 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7726d-aa08-4f4b-9904-63587a914c16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:27.949169 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7726d-aa08-4f4b-9904-63587a914c16 service placement] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:27.961490 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 613/1228] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:41:36.423993 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=3 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:37.955798 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=10 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:42.136093 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:41:42.162819 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8648590-d005-4b4b-9970-bea293c68701 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:41:42.167594 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:41:42.168380 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:41:42.168838 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:41:42.169263 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:41:42.181868 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:41:42.183803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:41:42.200231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 616/1229] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:41:42 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:52.192720 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=10 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:09.163797 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:09.164686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:09.164686 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:09.184585 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] MFA Rules not processed for user `bd787e0ad3b4482c8620b0c87b508ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:43:09.185828 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:43:09.193628 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 614/1230] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:43:09 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 14:43:19.178533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=3 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:25.969082 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:26.019590 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f5f4f-1710-4b3f-8832-ef4b2b797b2d service neutron] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:26.027668 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:26.028582 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:26.028950 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:26.029316 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:26.042958 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:26.045927 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:26.062608 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 617/1231] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:25 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:36.054663 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=10 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:39.324410 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:39.339752 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0324-f387-48b8-a44b-f804b40c655f None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:39.344768 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:39.345582 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:39.345978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:39.346339 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:39.360336 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:39.362301 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:39.379465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 615/1232] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:43:40.197095 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:40.220698 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454f3a-896e-4510-837f-59e23db1dc41 service nova] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:40.231334 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:40.233636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:40.234318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:40.234798 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:40.261611 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:40.263833 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:40.281133 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 618/1233] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:40 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:49.372092 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=6 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:50.272892 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=6 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:58.403278 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:43:58.421988 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d212-785e-4363-bc56-0b1763a18add service neutron] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:43:58.429852 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816a249-9094-468b-9ca8-b802ae1b0ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:43:58.430966 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816a249-9094-468b-9ca8-b802ae1b0ad6 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:43:58.431671 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816a249-9094-468b-9ca8-b802ae1b0ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:43:58.432122 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816a249-9094-468b-9ca8-b802ae1b0ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:43:58.442915 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816a249-9094-468b-9ca8-b802ae1b0ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:43:58.446200 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816a249-9094-468b-9ca8-b802ae1b0ad6 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:43:58.464714 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 616/1234] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:43:58 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:02.229496 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:02.252464 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2d3f3-70ba-494c-82ec-00df3b3200cc service neutron] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:02.263099 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:02.264843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:02.264843 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:02.265370 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:02.283564 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:02.285201 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:02.298161 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 619/1235] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:03.591442 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:03.592149 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:03.592723 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:03.626004 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:44:03.628188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:44:03.640829 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 617/1236] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:44:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:44:04.029011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:04.042153 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56ee7-7a73-408a-ab20-7718a9f8865b service nova] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:04.048840 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:04.050006 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:04.050515 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:04.051038 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:04.063595 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:04.065215 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:04.075339 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 620/1237] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:04.499104 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:04.517075 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d981bf-810d-4f27-8321-eb6d456ec64e None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:04.524609 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:04.525661 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:04.526208 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:04.526571 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:04.544744 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:04.546892 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:04.560826 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 618/1238] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:44:04.785810 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:04.809347 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4414297-98d5-484c-9fe3-953e3f266ca0 service neutron] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:04.816106 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:04.817115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:04.817637 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:04.818166 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:04.830246 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:04.832956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:04.855729 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 621/1239] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:04 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:14.186002 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:14.205496 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c34cd-dfc2-400e-8cc7-0ccf8c8790ca service neutron] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:14.215763 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:14.216964 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:14.217465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:14.217998 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:14.235497 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:14.239048 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:14.259359 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 619/1240] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:44:14.847064 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=18 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:24.250453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=21 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:53.381133 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:44:53.469185 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a480d0-35e7-44ac-85c6-5059e000111f service placement] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:44:53.479203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a46a2-f858-4edb-93eb-bdf22199d57e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:44:53.480164 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a46a2-f858-4edb-93eb-bdf22199d57e service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:44:53.480577 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a46a2-f858-4edb-93eb-bdf22199d57e service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:44:53.480972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a46a2-f858-4edb-93eb-bdf22199d57e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:44:53.492718 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a46a2-f858-4edb-93eb-bdf22199d57e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:44:53.495056 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a46a2-f858-4edb-93eb-bdf22199d57e service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:44:53.511123 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 622/1241] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:44:53 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:00.405584 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:00.436471 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602508d4-5498-4c92-9fda-48786e8b2e57 service nova] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:00.440841 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3190b-40e0-4587-bc42-8474894c9f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:00.441505 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3190b-40e0-4587-bc42-8474894c9f7c service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:00.441795 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3190b-40e0-4587-bc42-8474894c9f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:00.442077 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3190b-40e0-4587-bc42-8474894c9f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:00.530877 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3190b-40e0-4587-bc42-8474894c9f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:00.532405 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3190b-40e0-4587-bc42-8474894c9f7c service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:00.554742 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 620/1242] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:03.503295 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=20 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:04.706406 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1048c6-865d-43ab-b301-a8fbbd7ee36c None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.707209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1048c6-865d-43ab-b301-a8fbbd7ee36c None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.707209 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1048c6-865d-43ab-b301-a8fbbd7ee36c None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.708545 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 623/1243] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 14:45:04.719424 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc4b04-916e-449c-990a-e804645d441d None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.720280 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc4b04-916e-449c-990a-e804645d441d None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.720503 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc4b04-916e-449c-990a-e804645d441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.822684 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-97dc4b04-916e-449c-990a-e804645d441d None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:45:04.824246 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-97dc4b04-916e-449c-990a-e804645d441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:04.845154 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 621/1244] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:45:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:45:04.857738 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1048c6-865d-43ab-b301-a8fbbd7ee36c None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:04.871797 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1048c6-865d-43ab-b301-a8fbbd7ee36c None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:04.876854 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:04.877505 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:04.877824 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:04.878260 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:04.892108 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:04.893867 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:04.905434 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 624/1245] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:45:04 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:08.766245 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc4b04-916e-449c-990a-e804645d441d None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:08.784580 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc4b04-916e-449c-990a-e804645d441d None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:08.791190 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:08.792304 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:08.792687 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:08.793188 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] PATH_INFO: `/v3/users/bd787e0ad3b4482c8620b0c87b508ebf` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:08.795024 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd787e0ad3b4482c8620b0c87b508ebf)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:08.796105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: WARNING py.warnings [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:45:08.796105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: warnings.warn(msg) Jul 14 14:45:08.796105 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: Jul 14 14:45:08.797343 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:08.903166 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd787e0ad3b4482c8620b0c87b508ebf'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:08.926431 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd787e0ad3b4482c8620b0c87b508ebf'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:08.927129 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd787e0ad3b4482c8620b0c87b508ebf'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:08.929181 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:08.938337 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd787e0ad3b4482c8620b0c87b508ebf'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:08.952827 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd787e0ad3b4482c8620b0c87b508ebf'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:08.962449 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 622/1246] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jul 14 14:45:08 2022] DELETE /identity/v3/users/bd787e0ad3b4482c8620b0c87b508ebf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:09.199146 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:09.220318 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d822-8174-42dc-8e59-bb3f8c743afe service placement] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:09.301996 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:09.302907 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:09.303237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:09.303510 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] PATH_INFO: `/v3/projects/e907a2fa1e3947b4bb3ee6afe633a839` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:09.305910 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e907a2fa1e3947b4bb3ee6afe633a839)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:09.306956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: WARNING py.warnings [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:45:09.306956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: warnings.warn(msg) Jul 14 14:45:09.306956 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: Jul 14 14:45:09.308242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:09.384682 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e907a2fa1e3947b4bb3ee6afe633a839', 'request_id': 'req-1ee72a69-fe8d-45d7-8402-b31669371ee6'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.404783 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e907a2fa1e3947b4bb3ee6afe633a839', 'request_id': 'req-1ee72a69-fe8d-45d7-8402-b31669371ee6'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.414404 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e907a2fa1e3947b4bb3ee6afe633a839', 'request_id': 'req-1ee72a69-fe8d-45d7-8402-b31669371ee6'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.442931 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] The token cache is being invalidate because project e907a2fa1e3947b4bb3ee6afe633a839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:09.443312 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.444049 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.447240 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 625/1247] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:09 2022] DELETE /identity/v3/projects/e907a2fa1e3947b4bb3ee6afe633a839 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:09.454030 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:09.456372 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:09.475711 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19812-ba20-424f-a760-f7bd79bc02ff admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:09.545782 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:09.546677 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:09.546965 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:09.547283 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] PATH_INFO: `/v3/users/d38d0860ae29454292d5761de68feb55` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:09.548553 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38d0860ae29454292d5761de68feb55)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:09.550680 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:09.612843 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38d0860ae29454292d5761de68feb55'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.630154 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38d0860ae29454292d5761de68feb55'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.630931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38d0860ae29454292d5761de68feb55'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.641521 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38d0860ae29454292d5761de68feb55'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.651754 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-0cfb42e6-d242-4c51-a3dc-8b94e83f9c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38d0860ae29454292d5761de68feb55'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:09.658805 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 623/1248] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jul 14 14:45:09 2022] DELETE /identity/v3/users/d38d0860ae29454292d5761de68feb55 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:09.915642 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:45:09.918358 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:45:09.940696 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee72a69-fe8d-45d7-8402-b31669371ee6 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:45:10.032946 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:45:10.033933 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:45:10.034273 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:45:10.034607 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] PATH_INFO: `/v3/projects/b7dc8b60e0d94d2a921056e89891221a` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:45:10.036021 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dc8b60e0d94d2a921056e89891221a)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:45:10.038024 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:45:10.048256 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:10.107429 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dc8b60e0d94d2a921056e89891221a', 'request_id': 'req-a529607a-8532-4561-bbc0-003c399ba226'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:10.118687 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dc8b60e0d94d2a921056e89891221a', 'request_id': 'req-a529607a-8532-4561-bbc0-003c399ba226'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:10.129527 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dc8b60e0d94d2a921056e89891221a', 'request_id': 'req-a529607a-8532-4561-bbc0-003c399ba226'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:10.146796 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] The token cache is being invalidate because project b7dc8b60e0d94d2a921056e89891221a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:45:10.147184 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:10.148570 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-a529607a-8532-4561-bbc0-003c399ba226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:45:10.150423 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 626/1249] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:09 2022] DELETE /identity/v3/projects/b7dc8b60e0d94d2a921056e89891221a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:45:19.654928 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=59 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:20.143039 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:10.938230 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:10.938942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:10.938942 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:10.959386 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] MFA Rules not processed for user `fb9b3a0f88d1457faf922a043b88f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:10.960733 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:11.025765 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 624/1250] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jul 14 14:46:10 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:11.560631 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] REQUEST_METHOD: `POST` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:11.561482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:11.561482 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:11.604901 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.auth.core [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] MFA Rules not processed for user `22fcac88391d48e1a19591ab0ac05210`. Rule list: `[]` (Enabled: `True`). {{(pid=87186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:46:11.606224 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:11.668338 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 627/1251] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jul 14 14:46:11 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:46:11.684134 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:46:11.685893 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:46:11.700465 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e50-74fd-4c6f-9eff-8d676e04b1d3 None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:46:11.704566 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:46:11.705232 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:46:11.705513 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:46:11.705787 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:46:11.714931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:46:11.716446 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:46:11.725886 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 625/1252] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:46:11 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:21.661381 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=29 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:21.721830 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=31 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:24.449930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:47:24.452130 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:24.556383 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6fcb0-0942-4d1d-b429-4887ffa42774 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:47:24.565792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:47:24.568042 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:47:24.568605 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:47:24.569115 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:47:24.574403 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:47:24.597170 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:47:24.600636 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:47:24.624717 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 628/1253] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:47:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:47:34.616371 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=32 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:59.233074 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:48:59.234533 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:59.338325 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d70e4-572a-4b40-ae94-42e018230631 service neutron] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:48:59.342119 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef8b686560994350b28cd4c6016b4fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:48:59.342776 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:48:59.343108 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:48:59.343370 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:48:59.345257 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:48:59.385223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:48:59.386689 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:48:59.407774 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 626/1254] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:48:59 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:02.729859 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:02.731736 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:02.766231 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03cca7-6c3f-426b-ac5e-c945a00d1023 service placement] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:02.772652 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:02.773924 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:02.774498 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:02.775116 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:02.778241 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:02.920994 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:02.923803 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:02.940168 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 629/1255] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:04.187427 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:04.200542 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64636e12-6c9e-4e0b-9fef-b8c72cb9e03f service cinder] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:04.205195 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:04.206016 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:04.206443 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:04.206812 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:04.208985 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:04.226381 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:04.228881 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:04.246833 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 627/1256] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:49:05.045635 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:05.047732 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:05.068325 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3908de-6bd3-4fdb-9ff7-1038c69f8a81 service neutron] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:05.074962 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69be22bfe524d48a0f2932f83694f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:05.076461 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:05.077183 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:05.077727 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:05.080747 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:05.099813 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:05.101563 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24d374-6ea2-4d82-afc4-2a23c13bf39d service nova] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:05.114000 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 630/1257] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:08.657423 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:08.667771 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834772b7-e16e-46e5-8f92-99ff339a6e20 service neutron] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:08.672182 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22fcac88391d48e1a19591ab0ac05210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:08.672848 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:08.673137 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:08.673411 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:08.677605 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:08.770200 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:08.772499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02c623-40cc-4159-89e4-b19fca9fbf4f service neutron] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:08.785035 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 628/1258] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:49:15.110471 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=48 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:17.010531 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95c3d-bbe7-4a27-9b9d-52a8f414c910 None None] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.011352 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95c3d-bbe7-4a27-9b9d-52a8f414c910 None None] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.011557 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95c3d-bbe7-4a27-9b9d-52a8f414c910 None None] PATH_INFO: `/` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:17.014154 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 631/1259] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jul 14 14:49:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 14:49:17.023978 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] REQUEST_METHOD: `POST` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.024564 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.025225 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:17.086428 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.auth.core [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] MFA Rules not processed for user `e5b6927509e6432cb18a2aa7136ee98d`. Rule list: `[]` (Enabled: `True`). {{(pid=87185) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 14:49:17.088774 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:17.103011 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be95c3d-bbe7-4a27-9b9d-52a8f414c910 None None] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:17.105818 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-4be95c3d-bbe7-4a27-9b9d-52a8f414c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:17.106231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 629/1260] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jul 14 14:49:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 14:49:17.129252 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:17.138726 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be95c3d-bbe7-4a27-9b9d-52a8f414c910 None None] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:17.142078 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f3f98-a959-43f4-815d-fb7ae1a8a3be None None] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:17.145503 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:17.146600 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.147086 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.147480 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] PATH_INFO: `/v3/users/fb9b3a0f88d1457faf922a043b88f892` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:17.147931 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:17.148593 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] REQUEST_METHOD: `GET` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.148880 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.149122 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9b3a0f88d1457faf922a043b88f892)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:17.149300 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:17.151856 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:17.160837 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:17.162808 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:17.176570 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 630/1261] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:49:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 14:49:17.238080 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9b3a0f88d1457faf922a043b88f892'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.239391 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9b3a0f88d1457faf922a043b88f892'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.252426 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9b3a0f88d1457faf922a043b88f892'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.268592 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9b3a0f88d1457faf922a043b88f892'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.269474 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9b3a0f88d1457faf922a043b88f892'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.285171 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 632/1262] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:17 2022] DELETE /identity/v3/users/fb9b3a0f88d1457faf922a043b88f892 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:17.529231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:17.541453 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=100 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:17.556393 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c29e5-dcb0-453b-9da6-2b01e71731dc service placement] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:17.655238 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:17.657382 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.657901 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.658412 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] PATH_INFO: `/v3/projects/53fc50918b084f7b9b034f7a9f87704b` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:17.660527 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fc50918b084f7b9b034f7a9f87704b)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:17.664196 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:17.734062 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fc50918b084f7b9b034f7a9f87704b', 'request_id': 'req-a01fa679-5855-46fd-9bd8-0453c5906b48'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.741033 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fc50918b084f7b9b034f7a9f87704b', 'request_id': 'req-a01fa679-5855-46fd-9bd8-0453c5906b48'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.752452 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fc50918b084f7b9b034f7a9f87704b', 'request_id': 'req-a01fa679-5855-46fd-9bd8-0453c5906b48'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.773970 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] The token cache is being invalidate because project 53fc50918b084f7b9b034f7a9f87704b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87185) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:49:17.774231 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.774858 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.776647 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 631/1263] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:17 2022] DELETE /identity/v3/projects/53fc50918b084f7b9b034f7a9f87704b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:17.781634 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:17.783460 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:17.798107 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29364-fcfb-4431-ae71-93b827697007 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:17.868432 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:17.869393 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:17.869828 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:17.870117 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] PATH_INFO: `/v3/users/149046fabf544e5aaafa8b9d5a3764cb` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:17.888475 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149046fabf544e5aaafa8b9d5a3764cb)` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:17.892930 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:17.972975 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149046fabf544e5aaafa8b9d5a3764cb'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.973710 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149046fabf544e5aaafa8b9d5a3764cb'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.984242 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149046fabf544e5aaafa8b9d5a3764cb'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:17.994268 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:18.003999 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149046fabf544e5aaafa8b9d5a3764cb'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.006276 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.notifications [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149046fabf544e5aaafa8b9d5a3764cb'} {{(pid=87186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.024321 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 633/1264] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jul 14 14:49:17 2022] DELETE /identity/v3/users/149046fabf544e5aaafa8b9d5a3764cb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 14:49:18.274464 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Authenticating user token {{(pid=87185) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:49:18.275972 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.fernet_utils [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87185) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:49:18.294275 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fa679-5855-46fd-9bd8-0453c5906b48 admin admin] Validating token access rules against request {{(pid=87185) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:49:18.392850 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '186dc468057544fb86abd90933430e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a3ee9626d64c6bbe126c49645c1edd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87185) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:49:18.394299 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:49:18.395969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] SCRIPT_NAME: `/identity` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:49:18.395969 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] PATH_INFO: `/v3/projects/c7c3952486854b3c9f7d3923355cde64` {{(pid=87185) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:49:18.417198 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c3952486854b3c9f7d3923355cde64)` {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:49:18.419402 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] RBAC: Authorization granted {{(pid=87185) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:49:18.465223 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:18.497522 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c3952486854b3c9f7d3923355cde64', 'request_id': 'req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.507508 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c3952486854b3c9f7d3923355cde64', 'request_id': 'req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.518253 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c3952486854b3c9f7d3923355cde64', 'request_id': 'req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991'} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.534239 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] The token cache is being invalidate because project c7c3952486854b3c9f7d3923355cde64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87185) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 14:49:18.534537 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.535368 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG keystone.notifications [None req-7efe69f5-3cfb-4c73-b11f-a53bdf4cb991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87185) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 14:49:18.537284 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: [pid: 87185|app: 0|req: 632/1265] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:18 2022] DELETE /identity/v3/projects/c7c3952486854b3c9f7d3923355cde64 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 14:49:28.020017 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:28.530499 dv-osbrick-849858-1-ceph devstack@keystone.service[87185]: DEBUG dbcounter [-] [87185] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:29.338203 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Authenticating user token {{(pid=87186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 14:52:29.339667 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:29.428132 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c46b3-ca38-4100-8024-65aeb1486a21 admin admin] Validating token access rules against request {{(pid=87186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 14:52:29.493792 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b6927509e6432cb18a2aa7136ee98d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdb8d57f44342b8a29e027879d0f1d1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 14:52:29.494466 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] REQUEST_METHOD: `GET` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 14:52:29.494755 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] SCRIPT_NAME: `/identity` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 14:52:29.495076 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 14:52:29.496972 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.fernet_utils [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 14:52:29.509596 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 14:52:29.511237 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e02e0a-a1d2-4e6c-9c45-c5db3b67bd8d service placement] RBAC: Authorization granted {{(pid=87186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 14:52:29.521908 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: [pid: 87186|app: 0|req: 634/1266] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jul 14 14:52:29 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 14:52:39.517217 dv-osbrick-849858-1-ceph devstack@keystone.service[87186]: DEBUG dbcounter [-] [87186] Writing DB stats keystone:SELECT=62 {{(pid=87186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}